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independent  variable,  followed  by  assigning  numerical  weighting  factors  to 
statistical  measures  of  the  differences.  In  order  to  illustrate  the  applica- 
tion of  this  method,  comparisons  are  made  of  six  transmission  loss  models 
available  at  the  Naval  Underwater  Systems  Center  at  this  writing.  The  models 
are  compared  with  one  another  with  respect  to  the  parameters  given  above,  and 
the  predictions  are  compared  with  a set  of  PARKA  data  for  accuracy.  In  this 
process,  numerical  rankings  are  assigned  to  the  models.  However,  this  is  done 
solely  for  the  purpose  of  illustrating  the  method,  and  is  not  meant  as  an 
endorsement  of  any  model.  The  methodology  is  in  a state  of  evolution,  and  the 
final  version  may  differ  in  detail  from  the  one  presented  in  this  report. 
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FOREWORD 


The  Naval  Sea  Systems  Command  Panel  on  Sonar  Systems  Models  was 
chartered  to  make  recommendations  concerning  the  environmental  acoustic 
(EVA)  submodels  such  as  propagation  loss,  reverberation  and  ambient  noise  to 
be  used  in  NAVSEA  sponsored  sonar  system  programs. 

The  potential  tactical  sonar  applications  cover  such  a wide  spectrum 
that  it  is  unlikely  that  any  single  EVA  submodel  would  be  the  optimum  choice 
in  all  instances.  It  was  thus  decided  that  a matrix  of  information  addressing 
those  considerations  which  compose  the  model  selection  process  be  constructed 
for  candidate  EVA  submodels.  The  analyst  or  user  could  then  make  the  required 
trade-offs  based  on  the  quantitative  matrix  information  and  select  the  submodel 
best  suited  to  his  particular  application.  The  methodology  required  to  per- 
form the  objective  model  assessment  is  described  in  this  volume  and  exemplified 
by  extensive  application  to  propagation  loss  submodels  for  a Pacific  Ocean 
scenario.  Future  plans  include  the  assessment  of  propagation  loss  submodels, 
in  use  at  Navy  laboratories  and  Fleet  Numerical  Weather  Central,  for  other 
scenarios.  The  first  of  these,  using  Mediterranean  Sea  data,  has  been  initiated. 
Later  volumes  will  apply  the  assessment  methodology  to  ambient  noise  and  re- 
verberation submodels. 


Copies  of  this  report  can  be  obtained  through  Defense  Documentation  Center, 
Defense  Supply  Agency,  Cameron  Station,  Alexandria,  VA  22314. 


C.  D.  SMITH,  DIRECTOR 
SONAR  TECHNOLOGY  OFFICE 
06H1/036 
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A METHODOLOGY  FOR  THE  COMPARISON  OF'  MODELS 
FOR  SONAR  SYSTEM  APPLICATIONS  --  VOLUME  I 


INTRODUCTION 

In  the  area  of  underwater  acoustics  the  development  of  models  in  recent  years 
has  progressed  rapidly.  Although  to  the  casual  observer  it  would  appear  that  many 
models  exist  which  are  purported  to  describe  the  same  physical  phenomenon  and  that, 
therefore,  duplication  of  effort  has  been  common,  this  is  not  the  case.  Rather,  the 
variety  of  models  arises  from  the  choice  of  physical  theories  available  to  describe 
the  phenomenon,  assumptions  involving  a description  of  environmental  conditions 
affecting  the  phenomenon,  and  method  selected  for  a computer  implementation  of  the 
process.  The  models  which  shall  be  examined  here  are  those  which  generate  trans- 
mission loss  as  a function  of  range.  The  various  transmission  loss  models  may  be 
grouped  in  generic  types  as  given  in  table  1.  Within  each  type  several  models  may 
exist  which  differ  in  their  description  and  assumptions  concerning  environmental 
input  parameters.  Faced  with  a large  number  of  models  designed  to  describe  the 
same  phenomenon  and  with  the  requirement  to  select  a single  model  for  incorporation 
into  an  operational  system  or  for  the  purposes  of  system  design  or  research,  one 
must  find  bases  from  which  an  optimum  selection  can  be  made.  Factors  which  must  be 
taken  into  account  include  the  environments,  modes  of  operation,  and  tactical  situ- 
ations over  which  the  model  must  achieve  a given  level  of  performance.  The  decision 


Table  1.  Generic  Types  of  Transmission  Loss  Models 

A.  Semi-Empirical/Semi-Analytical  Models 

B.  Ray  Theory  Models  with  Corrections 

C.  Normal  Mode  Theory  Models 

D.  Total  Field  Models 

E.  Models  with  Range  Dependent  Inputs 

F.  Generalized  Ray  Models 

G.  Time  Domain  (Waveform  Prediction)  Models 

H.  Exact  Solutions 
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to  select  a model  for  inclusion  into  a given  system  or  to  be  applied  to  a specific 
requirement  will  depend  on  a matrix  for  each  candidate  model  such  as  that  given  in 
table  2.  Such  a matrix  will  be  formed  for  transmission  loss  models  available  at 
t he  New  London  Laboratory  of  the  Naval  Underwater  Systems  Center  (NUSC) . Accuracy 
will  be  assessed  quantitatively  through  comparisons  with  "standards"  for  selected 
cases.  The  accuracy  required  will,  of  course,  depend  on  the  application.  The 
amount  of  computer  time  required  to  run  a given  sub-model  is  of  concern  due  to  the 
cost  involved.  Also,  for  certain  applications  such  as  a sonar  trainer,  a specific 
requirement  of  maximum  allowable  running  time  may  be  necessary.  The  amount  of 
computer  storage  required  is  a critical  factor;  if  the  most  accurate  model  requires 
more  core  than  is  available  in  the  computer  on  which  the  program  is  to  be  run,  that 
particular  model  would  be  useless.  Ease  of  implementation  is  a factor  which  is  re- 
flected in  terms  of  cost  and  time.  Included  here  are  issues  such  as  the  compati- 
bility of  computers  and  availability  of  a programmer  intimately  familiar  with  the 
given  model.  The  complexity  of  program  execution  should  vary  with  the  application; 
thus,  a program  for  shipboard  use  should  be  simple  to  operate  and  decisions  con- 
cerning choice  of  inputs  and  outputs  should  be  minimized  or  eliminated,  if  possible. 
A program  intended  for  a research  application  should  offer  great  flexibility  in 
choice  of  inputs  and  outputs  and  would,  therefore,  be  necessarily  more  complex. 
Often,  a program  can  be  made  more  efficient  in  terms  of  running  time,  core  storage, 
or  both,  without  affecting  accuracy  by  making  slight  alterations  to  the  program. 
Factors  D,  E,  and  F are  largely  dependent  upon  the  extent  to  which  and  the  clarity 
with  which  the  various  programs  have  been  documented.  For  the  specific  transmission 
loss  models  constituting  the  study  herein  reported,  available  documentation  is  list- 
ed in  the  references.  Finally,  available  ancillary  information  might  include  such 
data  as  arrival  angle  versus  range  or  signal  intensity  as  received  by  an  array. 


Table  2.  Factors  Influencing  Model  Selection 

A.  Assessment  of  Accuracy 

B.  Computer  Running  Time 

C.  Amount  of  Computer  Storage  Required 

D.  Ease  of  Implementation 

E.  Complexity  of  Program  Execution 

F.  Ease  of  Effecting  Slight  Alterations  to  the  Program 

G.  Available  Ancillary  Information 


The  material  presented  below  is  intended  to  serve  as  an  example  of  a matrix 
such  as  that  of  table  2.  The  most  difficult  portion  of  the  matrix  to  complete  is 
the  assessment  of  accuracy.  The  usual  method  of  graphically  comparing  outputs  is  a 
qual itative  one  and  the  conclusions  obtained  may  be  subjective.  The  approach 
applied  here  characterizes  the  data  in  terms  of  a mean  and  standard  deviation,  each 
of  which  is  a function  of  the  independent  variable  (e.g.,  range,  azimuth  or  time). 
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Two  or  more  data  sets  are  then  compared  by  statistical  techniques  yielding 
quantitative  measures  of  agreement.  Although  the  examples  to  be  discussed  speci- 
fically deal  with  transmission  loss  versus  range,  the  applicability  of  the  compari- 
son method  is  not  restricted  to  such  data. 

For  the  models  constituting  this  study,  running  times  are  given  with  and  with- 
out normalization  for  the  number  of  points  generated  by  each  model.  The  amount  of 
computer  storage  required  is  that  for  the  models  as  they  exist  at  NUSC  and  run  on 
the  Univac  1108  computer. 

The  comparisons  herein  reported  were  performed  without  interaction  with  any 
potential  user  and  without  regard  to  any  particular  operational  system  or  other 
application.  The  comparisons  were  made  for  a selected  set  of  cases  and  utilized  a 
single  sound  speed  profile  and  bottom  type.  In  six  of  the  cases  examined,  a model, 
the  Fast  Field  Program  (FFP) , constituted  the  basis  of  comparison;  in  the  remaining 
two  cases,  transmission  loss  data  from  the  PARKA  experiment  as  analyzed  in  American 
Standard  one-third  octave  bands  were  compared  with  the  outputs  of  models  which 
assume  the  source  to  emit  a continuous  sinusoidal  signal  (with  the  exception  of  a 
simulated  one-third  octave  prediction  from  the  superposition  of  FFP  outputs  from 
CW  sources  within  the  band). 

The  examples  selected  and  the  comparisons  performed  have  as  their  purpose  the 
demonstration  of  a methodology  for  model  selection.  The  models  selected  for  this 
study  were  those  readily  available  at  NUSC  and  are  optimized  to  varying  degrees  for 
running  time  and  storage  requirements.  Only  a single  environmental  scenario  was 
examined  and  the  actual  data  used  in  the  comparisons  might  be  considered  too  sparse 
for  this  process.  Further,  when  outputs  from  models  assuming  CW  sources  are  com- 
pared with  one-third  octave  data,  the  results  are  open  to  interpretation.  For 
these  reasons,  the  results  of  this  study  do  not  constitute  an  endorsement  of  any 
model . 
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ENVIRONMENTAL  INPUTS 


Sound  Speed  Profile.  The  sound  speed  profile  used  in  all  listed  models  except 
the  FFP  is  shown  in  figure  1.  Figure  1A  shows  the  complete  profile,  and  figure  IB 
shows  the  profile  to  a depth  of  2000  feet  in  greater  detail.  Also  shown  in  this 
figure  is  a table  of  the  values  plotted  in  the  curves.  This  profile  is  based  on  a 
profile  measured  during  the  PARKA  exercise  conducted  in  the  Pacific  Ocean  during 
the  period  November-December  1969.  The  measured  profile  had  additional  points  which 
were  considered  extraneous  and  were  eliminated  to  produce  the  plotted  profile. 

The  FFP  utilized  a 5-point  approximation  to  the  PARKA  profile  as  given  in 
figure  2.  This  approximation  was  made  necessary  by  the  manner  in  which  the  profile 
is  used  in  FFP.  The  FFP  model  assumes  that  the  medium  is  stratified  as  a function 
of  depth  and  that  within  the  J-th  layer  the  sound  speed  is  given  by 

CJ(2)  = cJ-l(zj)exP  t ±Cz-Zj)/hj  1 

where  J = 1,  2,  3,...  and  c(Zj)  is  the  sound  speed  at  z = z^  (the  surface).  The 

parameter  Hj  is  a scale  factor  which  will  have  a different  magnitude  in  each  layer. 

A condition  related  to  the  numerical  procedures  used  in  the  FFP  is  that  H /Hr  be 

r max  J 

an  integer,  where  H is  the  largest  scale  factor  in  absolute  magnitude.  These 
nicix 

ratios  are  also  related  to  the  amount  of  computer  storage  required.  Because  of 
these  last  two  factors,  it  is  often  impractical  to  fit  a given  sound  speed  profile 
arbitrarily  closely  for  use  in  FFP. 

An  example  of  the  effect  of  approximating  the  sound  speed  profile  is  to  be  seen 
by  considering  the  deep  portion  of  the  profile  as  typically  found  in  the  Pacific. 

The  profile  usually  exhibits  a small  amount  of  curvature,  whereas  its  practical  FFP 
version  would  be  almost  linear.  The  effect  on  the  propagation  loss  of  using  the 
almost  linear  fit  is  to  cause  a systematic  shift  in  the  ranges  at  which  the  con- 
vergence zones  will  occur.  Thus,  the  absolute  differences  between  the  FFP  as  run 
with  a 5 point  sound  speed  profile  and  other  models  run  with  the  29  point  profile 
require  careful  scrutiny  if  an  interpretation  of  the  difference  is  required.  How- 
ever, all  models  compared  with  the  FFP  did  utilize  the  29  point  profile;  hence,  the 
relative  accuracy  assessments  between  models  constituting  this  study  are  based  upon 
a common  description  of  the  sound  speed  environment. 

Bottom  Loss.  Figure  3 shows  bottom  loss  per  bounce  as  a function  of  grazing 
angle,  as  used  in  all  models  except  the  FFP.  The  curve  is  constructed,  assuming 
Rayleigh  reflection,  from  parameters  based  upon  NAVOCEANO  data  at  100  Hz.  The  FFP 
uses  inputted  bottom  parameters  directly  to  compute  bottom  loss.  These  bottom 
parameters  are:  density  Pg,  sound  speed  Cg,  and  attenuation  coefficient  ctg.  The 

same  parameters  in  the  water,  namely,  p w,  Cw>  and  are  also  required.  The  set  of 

values  used  in  all  cases  was: 

°B/pW  = 2'3 

CB  = 5144  ft/sec 

= 5088  ft/sec 

aB  = 0. 
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The  attenuation  coefficient  in  the  water  used  in  the  FFP  is  essentially  that  given 
by  Thorp.  The  same  bottom  characteristics  were  used  in  all  cases.  Since  bottom 
loss  is  known  to  be  a frequency  dependent  parameter,  the  use  of  a single  curve  at 
50,  500,  and  2000  Hz  based  on  data  obtained  for  a frequency  of  100  Hz  would  appear 
to  be  questionable.  However,  the  authors  were  unable  to  locate  bottom  loss  data 
at  50  and  400  Hz  pertinent  to  the  PARKA  transmission  loss  data  used  in  cases  7 
and  8 and,  therefore,  the  available  data  at  100  Hz  were  used.  The  use  of  these 
data  at  2000  Hz  in  cases  1-6  is  unrealistic  but  does  not  have  a significant  impact 
on  the  intent  of  this  study,  since  the  purpose  is  to  demonstrate  a methodology 
for  the  assessment  of  the  relative  accuracies  of  various  models.  The  methodology 
certainly  does  not  depend  upon  the  choice  of  bottom  loss  parameters.  Additionally, 
the  comparison  results  should  be  fairly  insensitive  to  the  specific  choice  of 
bottom  loss. 
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FIGURE 
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DESCRIPTION  OF  APPROACH  AND  CASES  EXAMINED 


Typically  in  underwater  acoustics,  both  model  outputs  and  experimental  data 
(such  as  ambient  noise  versus  azimuth,  reverberation  level  versus  time  and  trans- 
mission loss  versus  range)  exhibit  rapid  and  pronounced  fluctuations.*  The  fluctu- 
ations make  quantitative  comparisons  difficult  to  perform  and  even  more  difficult 
to  interpret.  In  order  to  overcome  these  difficulties,  comparisons  can  be  made 
between,  for  example,  smoothed  records  of  transmission  loss  versus  range.  The 
smooth  records  can  be  considered  as  representing  a range  dependent  mean.  According- 
ly, polynomials  were  fitted  to  each  propagation  loss  versus  range  record  (with  the 
exception  of  those  utilizing  incoherent  phase  addition  or  for  which  a one-third 
octave  simulated  result  was  obtained,  since  either  process  leads  to  a smooth  curve) 
so  as  to  minimize  the  mean-square  error  (in  dB  space). 

In  the  examples  that  follow,  plots  of  propagation  loss  as  a function  of  range 
were  divided  into  a number  of  segments,  and  each  segment  was  fitted  with  a poly- 
nomial of  seventh  degree  or  less.  The  segments  were  chosen  to  adequately  represent 
the  range  dependent  mean,  and  their  number  and  locations  were  determined  by  signi- 
ficant features  and  changes  in  the  plot  (such  as  boundaries  of  convergence  zones). 

The  use  of  a moving  average  in  lieu  of  polynomials  to  represent  the  range 
dependent  mean  can  reduce  the  degree  of  subjectivity,  particularly  that  involved  in 
dividing  a record  into  segments.  Examples  and  a discussion  of  the  use  of  the  moving 
average  in  this  context  are  given  in  appendix  A.  It  is  intended  in  future  investi- 
gations to  use  moving  averages,  rather  than  polynomials,  for  data  smoothing. 


‘Further  discussion  of  fluctuation  in  this  report  will  focus  upon  transmission  loss 
versus  range.  However,  the  methodologies  to  be  developed  and  the  approach  taken 
have  general  applicability. 


8 


The  comparisons  constituting  this  study  fall  into  two  general  groups:  (I)  FFP 

used  as  the  basis  of  comparison  for  the  models  listed  in  table  3A;  (II)  data  from 
the  PARKA  experiment  used  as  the  basis  of  comparison  for  the  models  listed  in  table 
3B.  The  model  listed  in  table  3B  as  FFP  (1/3-Octave)  produces  an  output  which 
approximates*  the  process  of  1/3-octave  filtering  of  a broadband  source. 


Table  3A.  Models  Compared  With  The  Fast 
Field  Program  (FFP) 

CONGRATS  V (Coherent  Phase  Addition) 

CONGRATS  V (Incoherent  Phase  Addition) 

FACT  (Coherent  Phase  Addition) 

FACT  (Incoherent  Phase  Addition) 

NISSM  II  (Coherent  Phase  Addition) 

NISSM  II  (Incoherent  Phase  Addition) 

RAYMODE  IV  (Coherent  Phase  Addition) 

RAYMODE  IV  (Incoherent  Phase  Addition) 

RAYMODE  X (Coherent  Phase  Addition) 

RAYMODE  X (Incoherent  Phase  Addition) 


Table  3B.  Models  Compared  With  PARKA 
Data 

CONGRATS  V (Coherent  Phase  Addition) 
CONGRATS  V (Incoherent  Phase  Addition) 
FACT  (Coherent  Phase  Addition) 

FACT  (Incoherent  Phase  Addition) 

FFP 

FFP  (1/3-Octave) 

NISSM  II  (Coherent  Phase  Addition) 
NISSM  II  (Incoherent  Phase  Addition) 
RAYMODE  IV  (Coherent  Phase  Addition) 
RAYMODE  IV  (Incoherent  Phase  Addition) 
RAYMODE  X (Coherent  Phase  Addition) 
RAYMODE  X (Incoherent  Phase  Addition) 


*The  1/3-octave  result  is  formed  as  follows:  (1)  FFP  predictions  are  calculated  at 

single  frequencies  across  the  one-third  octave  band  (for  the  band  of  geometric  mean 
frequency  of  50  Hz,  predictions  were  produced  from  44  to  56  Hz  at  increments  of 
1 Hz;  for  the  band  of  geometric  mean  frequency  of  400  Hz,  a prediction  was  produced 
every  10  Hz  between  350  and  450  Hz);  (2)  the  real  and  imaginary  parts  of  the  re- 
sulting complex  pressures  are  averaged;  (3)  the  resulting  complex  pressure  is  multi 
plied  by  its  complex  conjugate,  and  (4)  10  times  the  logarithm  of  the  resulting 
product  is  obtained. 


In  all  cases  comparisons  were  performed  to  a range  of  100  kyd.  With  the  FFP 
as  the  standard  of  comparison  six  cases  were  examined,  as  shown  in  table  4A,  con- 
sisting of  three  frequencies  and  two  source/ receiver  depth  combinations.  As  can  be 
seen  in  figure  1,  a surface  duct  extends  to  a depth  of  280  feet.  Cases  1-3,  there- 
fore, correspond  to  source  and  receiver  being  within  this  layer,  whereas  cases  4-6 
correspond  to  source  and  receiver  both  being  below  the  surface  duct. 


Table  4A.  Parameters  for  Cases  1-6 


Case  No. 

Frequency 

(Hz) 

Source 
Depth  (ft) 

Receiver 
Depth  (ft) 

1 

50 

50 

50 

2 

500 

50 

50 

3 

2000 

50 

50 

4 

50 

500 

300 

5 

500 

500 

300 

6 

2000 

500 

300 

With  PARKA  data  forming  the  basis  of  comparison,  two  cases  were  examined 
(table  4B).  Case  7 has  parameters  identical  with  those  of  case  4.  Case  8 differs 
from  case  5 only  in  frequency,  the  difference  being  100  Hz. 


Table  4B.  Parameters  for  Cases  7 and  8 


Frequency 

Source 

Receiver 

Case  No. 

(Hz) 

Depth  (ft) 

Depth  (ft) 

7 

50 

500 

300 

8 

400 

i 

500 

300 

The  quantitative  comparisons  in  their  most  basic  form  are  the  graphical  outputs 
giving  the  range  dependent  differences  between  smoothed  data  sets.  For  the  cases 
and  models  constituting  this  study,  84  difference  curves  are  generated.  In  order  to 
more  easily  digest  this  information  it  is  condensed  and  summarized  in  the  form  of 
tables.  Toward  this  end,  the  data  for  each  difference  curve  were  divided  into  in- 
tervals of  twenty  kiloyards  (in  order  to  have  a sufficient  number  of  sample  points 
for  meaningful  calculations  of  means  and  standard  deviations),  and  the  mean,  u,  and 
standard  deviation,  o,  of  the  differences  were  calculated  for  each  case  within  each 
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interval.  Means  and  standard  deviations  of  the  differences  were  also  calculated 
for  the  entire  range  interval  (100  kiloyards)  and  for  various  combinations  of  cases 
(A)  cases  1-3  (source  and  receiver  in  the  surface  layer),  (B)  cases  4-6  (source  and 
receiver  below  the  layer),  (C)  cases  1-6,  and  (D)  cases  7-8.  Table  5 shows  the 
number  of  points  contained  in  each  interval  and  in  the  entire  100  kyd  for  each 
model  and  for  the  PARKA  data. 


Table  5.  Number  of  Sample  Points  for  Models  and  PARKA  Data 


RANGE 

INTERVAL  (kyd) 

0-20 

20-40 

40-60 

60-80 

80-100 

— 

0-100 

CONGRATS  V 

49 

52 

51 

52 

52 

256 

FACT 

20 

20 

20 

20 

20 

100 

FFP 

(CW) 

255 

255 

255 

255 

255 

1275* 

FFP 

(1/3-octave) 

255 

255 

255 

255 

255 

1275* 

NISSM  II 

25 

26 

25 

26 

26 

128 

RAYMODE  IV 

20 

20 

20 

20 

20 

100 

RAYMODE  X 

40 

40 

40 

40 

40 

200 

PARKA 
(Case  7) 

8 

12 

10 

8 

7 

45 

PARKA 
(Case  8) 

6 

8 

6 

12 

7 

39 

*A  record  containing  4096  points  is  generated  by  the  FFP. 
However,  the  first  100  kyd  contain  1275  points. 
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DESCRIPTION  OH  MODELS 


CONGRATS  V - The  CONGRATS  V model  expands  the  integral  representation  of  the 
acoustic  pressure  into  a geometric  series,  each  term  of  which  corresponds  to  a 
particular  ray  type.  A careful  evaluation  of  the  pertinent  quantities  involved 
avoids  problems  associated  with  ordinary  ray  theory. 

1 2 3 

The  Fast  Asymptotic  Coherent  Transmission  (FACT)  Model  ’ ’ - The  FACT  model 

is  a ray  acoustic  model  which  utilizes  higher  order  theory  for  the  solution  in  those 
areas  in  which  the  assumptions  of  ray  acoustics  lead  to  physically  unrealizable 
solutions.  Specifically,  the  infinite  intensities  resulting  from  geometric  ray 
theory  at  caustics  are  disregarded.  Instead,  the  acoustic  field  at  caustics  is 
evaluated  using  appropriate  asymptotic  expressions.  The  Clay-Tatro  Model4  is  used 
for  propagation  in  a surface  duct.  The  FACT  model  has  been  developed  and  programmed 
to  achieve  minimum  running  time.  The  model  development  was  sponsored  by  the  Long 
Range  Acoustic  Propagation  Project  (LRAPP) . Initially  developed  within  several  Navy 
and  industrial  laboratories,  a preliminary  version  of  the  FACT  model  was  turned  over 
to  the  Acoustic  Environmental  Support  Detachment  where  it  was  upgraded.  On 
April  1,  1973,  the  Acoustic  Environmental  Modeling  Coordinator,  Dr.  J.  B.  Mersey, 
designated  the  FACT  model  to  be  a new  Navy  Interim  Standard  Transmission  Model  for 
ocean  environments  which  may  be  adequately  described  by  a single  sound  speed  profile 
and  a flat  bottom. 

The  Fast  Field  Program  (FFP)*’  - The  FFP  applies  Fast  Fourier  Transform  methods 
to  acoustic  field  theory.  This  model  evaluates  the  exact  integral  solution  to  the 
wave  equation,  yielding  propagation  loss  as  a function  of  range.  The  FPP  should  be 
considered  more  accurate  than  many  normal  mode  and  ray  theory  solutions  because,  in 
general,  these  other  methods  represent  approximate  solutions  or  a part  of  the  exact 
solution.  It  is  for  this  reason  that  the  FFP  was  chosen  as  the  standard  of  compari- 
son in  cases  1-6.  The  FFP  was  developed  at  NUSC. 

The  Navy  Interim  Surface  Ship  Model  II  (NISSM  II)6  - NISSM  II  is  designed  to 
predict  the  performance  of  existing  and  proposed  active  sonar  systems  using  ray 
tracing  techniques.  It  is  a full  system  performance  model  in  that  it  calculates  the 
reverberation  field  and  includes  a detection  model.  The  propagation  loss  model  in 
NISSM  II  consists  of  a continuous  gradient  ray  theory  model  with  higher  order 
acoustic  corrections.  For  cases  of  source  and  receiver  in  a surface  duct,  NISSM  II 
calculates  transmission  loss  from  both  ray  theory  and  modified  AMOS  predictions,  but 
uses  the  result  giving  the  greatest  loss.  Since  this  model  was  designed  to  predict 
the  performance  of  active  sonar  systems,  its  use  in  this  study  at  frequencies  such 
as  50  and  500  Hz  may  be  somewhat  inappropriate.  NISSM  II  was  sponsored  by  the  Naval 
Sea  Systems  Command  (Code  06H1)  and  was  developed  by  NUSC  and  the  Naval  Undersea 
Center  (NUC). 

RAYMODE  IV  and  RAYMODE  X^’8  - The  RAYMODE  models  are  wave  propagation  loss 
models  which  allow  for  the  usual  normal  mode  solution  to  be  expanded  in  a ray  path 
series.  That  is,  the  acoustic  wave  solution  is  converted  into  a set  of  integral 
solutions  which  can  be  identified  as  various  ray  paths.  The  RAYMODE  models,  there- 
fore, allow  for  the  exact  normal  mode  wave  solutions  to  be  interpreted  in  terms  of 
ordinary  ray  paths  without  the  need  to  make  the  usual  ray  theory  approximations. 

RAYMODE  X differs  from  RAYMODE  IV  in  that  it  has  incorporated  advancements  in 
analysis  and  computational  techniques  and  is  thus  a more  efficient  model  and  more 
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accurate  in  calculating  solutions  to  the  governing  integral 
physical  process.  The  RAYMODE  IV  and  RAYMODE  X models  were 


representation  of  the 
developed  at  NLISC. 
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ASSESSMENT  01  ACCURACY 


Usually,  accuracy  is  assessed  in  a qual itative  manner  which  consists  of  over- 
plotting the  various  data  sets  and  describing  the  agreement  between  them  by  terms 
such  as  good, fair,  and  poor.  Of  course,  such  terms  are  subjective  and  that  which 
constitutes  good  agreement  for  one  application  may  be  poor  agreement  for  another. 

When  many  data  sets  are  being  compared,  the  process  of  overplotting  leads  to  con- 
fusion, especially  when  the  further  complication  of  several  scenarios  (such  as 
differing  sound  speed  profiles,  bottom  loss  regimes,  source/receiver  depth  combi- 
nations and  frequencies)  is  considered.  Also  adding  to  the  difficulty  of  making 
comparisons  are  the  rapid  fluctuations  exhibited  by  various  data  sets,  such  as 
exemplified  in  figure  4.  What  is  needed  to  ameliorate  the  situation  described  above 
is  a method  of  comparing  data  sets  that  leads  to  meaningful  quantitative  results. 
Accordingly,  a comparison  approach  was  adopted  in  this  investigation  that  produces 
outputs  which  form  a hierarchical  structure  providing  both  quantitative  measures 
sufficiently  concise  for  the  assessment  of  the  relative  accuracies  of  several  candi- 
date models  for  a given  application  and  intermediate  outputs  from  which  the  causes 
of  discrepancies  may  be  ascertained.  The  comparison  approach  consists  of  seven 
major  steps: 

(1)  Fitting  Polynomials  to  Raw  Data  Sets  - This  process  eliminates  the  rapid 
fluctuations  in  each  data  set  and  thus  permits  a comparison  of  the  data  sets  in 
terms  of  range  dependent  mean  values.  The  procedure  is  to  divide  each  data  set  into 
several  range  intervals  and  to  fit  a polynomial  of  appropriate  degree  in  each  inter- 
val. Figure  5 shows  the  result  of  this  process  as  applied  to  the  raw  data  of 
figure  4.  Intervals  are  chosen  on  the  basis  of  major  significant  features  of  the 
record  such  as  the  bottom  bounce  region  and  convergence  zone.  Features  such  as 
near  field  interference  patterns  are  strongly  affected  by  small  changes  in  frequency, 
source  or  receiver  depth,  and  sound  speed.  Such  features  are  sensitive  to  model 
assumptions  (e.g.,  a flat  bottom  and  a sound  speed  field  describable  by  a single 
profile)  and  the  manner  in  which  the  model  treats  the  sound  speed  data.  For  these 
reasons  such  features  are  averaged  (c.f,  figures  4 and  5). 

The  rapid  fluctuations  observed  in  transmission  loss  model  outputs  are  due  to 
constructive  and  destructive  interference  between  two  or  more  paths  (or  modes)  re- 
sulting from  coherent  phase  addition.  Models  which  use  incoherent  phase  addition 
tend  to  produce  outputs  essentially  lacking  in  fine-scale  fluctuations,  although 
major  features  arc  largely  retained.  For  this  reason,  outputs  of  models  using 
incoherent  phase  addition  arc  not  smoothed  by  fitting  polynomials. 

(2)  Calculation  of  Difference  (in  decibels)  Between  the  Standard  and  Each 
Appropriately-  Smoothed  Model  Output  as  a Function  of  Range  - For  Cases  1-6,  the 
standards  are  smoothed  FFP  outputs,  the  results  of  fitting  polynomials  to  major 
features;  for  Cases  7-8,  the  standards  are  FARKA  data.  An  example  of  a difference 
curve  is  shown  in  figure  6. 

(3)  Subdivision  of  the  Difference  of  (2)  into  Range  Intervals  - The  choice  of 
five  equal  intervals  of  20  kyd  was  made  for  this  study.  This  choice  ensures  that 
each  interval  is  large  enough  to  contain  sufficient  points  for  the  calculations  of 

(4)  to  be  of  significance  and  small  enough  so  that  each  interval  contains  no  more 
than  a single  major  feature.  The  number  of  sample  points  per  interval  is  given  in 
table  5 for  each  model  and  for  the  PARKA  data. 
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An  alternative  method  for  the  selection  of  range  intervals  would  be  to  divide 
the  record  according  to  regions  such  as  direct  path,  bottom  bounce,  and  convergence 
zone  on  the  basis  of  ray  path  analysis.  In  future  model  comparisons  the  method 
given  in  this  paragraph  will  be  used  for  the  determination  of  range  intervals. 

(4 ) Calculation  of  the  Mean  (p)  and  Standard  Deviation  (o)  of  Differences 
Within  Each  Range  Interval  for  Each  Case  - The  agreement  between  a given  model  out- 
put and  a standard  data  set  is  (at  this  point  in  the  procedure)  represented  by  two 
numbers  for  each  range  interval  for  a given  case  (or  a total  of  10  numbers  for  the 
entire  range  extent  for  each  case).  These  results  are  given  in  tables  C1-C8  of 
appendix  C,  where  table  Cl  gives  results  for  case  1,  table  C2  gives  results  for 
case  2,  etc.  The  last  two  columns  in  tables  C1-C8  give  the  mean  and  standard  devi- 
ation over  the  entire  range  extent.  (A  shortened  sample  version,  selected  from 
table  C4,  is  shown  as  table  6.)  Also  given  in  appendix  C are  means  and  standard 
deviations  of  differences  for  combinations  of  cases  for  each  range  interval  and  for 
the  entire  range.  The  case  combinations  1-3  (smoothed  FFP  the  standard,  source  and 
receiver  in  the  surface  layer),  4-6  (smoothed  FFP  the  standard,  source  and  receiver 
below  the  surface  layer),  1-6  (all  cases  for  which  smoothed  FFP  is  the  standard)  and 
7-8  (cases  for  which  PARKA  data  are  the  standard)  were  chosen  and  correspond  to 
tables  C9-C12  respectively.  The  results  presented  in  tables  C1-C12  are  also  re- 
arranged so  that  for  each  model  a table  is  given  which  displays  means  and  standard 
deviations  of  the  differences  between  the  standard  and  the  model  in  question  in  all 
range  intervals  for  each  case  and  the  combinations  of  cases  given  above.  These 
results  are  found  in  appendix  D. 


Table  6.  Means  and  Standard  Deviations  of  Differences 
Between  the  FFP*  and  Model  Results;  Case  4 


Range  Interval 
(kyd) 

0-20 

20-40 

40-60 

60-80 

80-100 

0-100 

V 

0 

u 

o 

U 

0 

u 

O 

u 

0 

u 

a 

CONGRATS  V* 
(Coherent) 

1.9 

1.5 

0.7 

1.8 

2.9 

4.0 

0.0 

6.3 

0.8 

1.8 

1.3 

3.7 

CONGRATS  V 
(Incoherent) 

IB 

2.3 

4.0 

m 

5.6 

7.3 

0.4 

5.1 

0.7 

2.8 

3.0 

5.1 

FACT* 

(Coherent) 

1.8 

2.1 

0.1 

3.8 

6.0 

3.0 

0.1 

4.0 

5.0 

3.6 

2.6 

4.1 

FACT 

(Incoherent) 

Efl 

2.2 

11 

Kfl 

6.2 

6.2 

0.5 

3.3 

3.2 

4.8 

*As  smoothed  by  polynomial  fits. 


(5)  Establishing  Weights  Corresponding  to  Values  of  the  Absolute  Value  of  the 
Mean  |p|  and/or  the  Standard  Deviation  o as  Obtained  in  (4)  - The  set  of  weights 
used  in  this  study  is  given  in  table  7.  Here,  it  is  tacitly  assumed  that  all  range 
intervals  and  cases  are  of  equal  importance.  In  general,  weights  would  be  assigned 
by  a user  in  accordance  with  considerations  such  as  tactical  requirements  and  modes 
of  operation.  Thus,  a user  might  apply  more  stringent  weights  in  the  convergence 
zone  (i.e.,  the  range  interval  between  60  and  80  kyd)  for  source  and  receiver  below 
the  surface  layer  at  a frequency  of  500  Hz  (i.e.,  case  5)  if  his  mission  emphasized 
the  importance  of  making  detections  for  such  a scenario. 
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Table  7.  Weights  Corresponding  to  Values  of  |u|  or  e 


w 

I u | ,o  (dB) 

1 

0. 0-2.9 

2 

3. 0-5. 9 

3 

6. 0-8.9 

4 

9.0-11.9 

5 

>12.0 

( 6 ) Determination  of  Measures  of  Accuracy  by  Summing  the  Weights* 

Corresponding  to  ] u ] and  o in  Each  Range  Interval  for  Each  Case  - At  this  point,  the 
accuracy  of  each  model  is  given  by  a single  value  in  each  range  interval/case  bin. 
The  results  of  this  process  are  given  in  appendix  C in  tables  C13A-C13E  and  C14A- 
C14B.  As  an  example,  a shortened  version  of  table  C13D  is  given  as  table  8. 


Table  8.  Sum  of  Weights*  Corresponding  to  Means  and  Standard  Deviations** 
of  Differences  Between  the  Smoothed  FFP  and  Model  Results;  Case  4 


Range  Interval 
(kyd) 

0-20 

20-40 

40-60 

60-80 

80-100 

CONGRATS  V 
(Coherent) 

2 

2 

3 

3 

CONGRATS  V 
(Incoherent) 

3 

4 

5 

3 

2 

FACT 

(Coherent) 

2 

3 

4 

3 

4 

FACT 

( Incoherent) 

3 

4 

6 

3 

3 

* As  defined  in  table  7. 
**  As  given  in  table  6. 


(7)  Determination  of  Cumulative  Measures  of  Accuracy  by  Averaging  the  Measures 
of  Accuracy  over  all  Range  Intervals  and  Cases  for  Which  a Given  Standard  was  Used  - 
(i.e..  Cases  1-6  utilized  FFP  as  the  standard;  Cases  7-8  utilized  PARKA  data  as  the 
standard).  The  cumulative  accuracy  measure  provides  a single  number  which  may  be 
used  to  compare  the  accuracies  of  several  models.  The  user  may  establish  an  accep- 
table level  for  this  measure;  all  models  with  cumulative  measures  of  accuracy  below 
this  level  would  then  be  regarded  as  providing  sufficiently  accurate  outputs. 

The  cumulative  accuracy  measure  for  each  model  resulting  from  comparison  with 
smoothed  FFP  results  is  given  in  table  9.  Two  models  are  seen  to  be  most  accurate: 
RAYMODE  X (coherent)  and  CONGRATS  V (coherent).  These  are  followed  in  accuracy  by 
the  incoherent  versions  of  RAYMODE  X and  CONGRATS  V and  then  FACT  (coherent)  and 
FACT  (incoherent).  The  NISSM  II  and  RAYMODE  IV  models,  using  either  coherent  or 
incoherent  phase  addition,  are  seen  to  be  the  least  accurate  models  in  comparison 
with  the  FFP.  In  general,  the  coherent  versions  of  models  compare  more  favorably 
with  the  FFP,  as  is  to  be  expected  (since  the  FFP  uses  coherent  phase  addition). 


*From  table  7. 
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Table  9.  Cumulative  Accuracy  Measure*  For  Each  Model 
Resulting  From  Comparison  With  Smoothed  FFP  Results 


CONGRATS  V 
(Coherent) 

2.60 

CONGRATS  V 
(Incoherent) 

2.90 

FACT 

(Coherent) 

2.97 

FACT 

(Incoherent) 

3.20 

NISSM  II 
(Coherent) 

3.97 

NISSM  II 
(Incoherent) 

4.03 

RAYMODE  IV 
(Coherent ) 

4.20 

RAYMODE  IV 
(Incoherent) 

3.80 

RAYMODE  X 
(Coherent) 

2.50 

RAYMODF.  X 
(Incoherent) 

2.73 

♦Weights  of  Tables  C13A-C13E  Averaged  Over  All 
Range  Intervals 

The  cumulative  accuracy  measure  for  each  model  resulting  from  comparison  with 
PARKA  data  is  given  in  table  10.  Here,  four  models  are  seen  to  be  most  accurate, 
namely,  RAYMODE  X (incoherent),  CONGRATS  V (coherent),  CONGRATS  V (incoherent)  and 
RAYMODE  IV  (incoherent).  The  incoherent  versions  of  models  are  seen  to  be  more 
accurate  than  coherent  versions  in  comparisons  with  PARKA  data.  The  PARKA  data  are 
the  result  of  processing  the  received  signal  in  1/3-octave  filters  and,  therefore, 
represent  averaging  over  frequency.  The  utilization  of  incoherent  phase  addition 
is  also  an  averaging  process.  Both  frequency  and  phase  averaging  result  in  smoothed 
outputs  essentially  lacking  in  rapid,  large  fluctuations.  It  is  to  be  expected  that 
such  records  will  show  better  agreement  than  that  between  records  which  represent 
broadband  results  (i.e.,  1/3-octave  PARKA  data)  and  narrowband  results  (i.e.,  coher- 
ent models  assuming  a CW  source).  To  test  the  effect  of  comparing  broadband  (1/3- 
octave)  and  narrowband  (CW)  results  as  opposed  to  comparing  two  broadband  outputs, 
the  FFP  was  run  as  a CW  and  a l/3-octave+  model  and  each  was  compared  with  the  1/3- 
octave  PARKA  data.  As  expected,  the  FFP  (1/3-octave)  shows  better  agreement  with 
the  PARKA  data. 


tUsing  superposition  of  CW  tonals  across  the  1/3  octave  band. 
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Table  10.  Cumulative  Accuracy  Measure*  For  Each  Model 
Resulting  From  Comparison  With  PARKA  data 


CONGRATS  V 
(Coherent) 

2.6 

CONGRATS  V 
(Incoherent) 

2.6 

FACT 

(Coherent) 

3.0 

FACT 

(Incoherent) 

2.9 

~ FFP 
(CW) 

3.  1 

FFP 

( 1/3-Octave) 

2.9 

NISSM  II 
(Coherent) 

3.4 

NISSM  II 
(Incoherent) 

2.8 

RAYMODE  IV 
(Coherent) 

3.3 

RAYMODE  IV 
(Incoherent) 

2.6 

RAYMODE  X 
(Coherent) 

3.0 

RAYMODE  X 
(Incoherent) 

2.5 

‘Weights  of  Tables  C14A-C14B  Averaged  Over  All 
Range  Intervals 


A REPRESENTATIVE  EXAMPLE 


Various  features,  choices,  and  conclusions  relating  to  the  graphs  merit  dis- 
cussion. Case  4 is  sufficiently  representative  so  that  most  major  points  of  inter- 
est are  manifest.  Figure  IV-1A  (of  appendix  B)  shows  a very  complex  interference 
pattern  to  a range  of  approximately  35  kyd  followed  by  a large  feature  extending  to 
58  kyd  at  which  point  a double- lobe  convergence  zone  (CZ)  is  found,  finally  followed 
by  a fairly  smooth  structure  between  75  and  100  kyd.  This  led  to  the  representation 
of  the  range  dependent  mean  by  five  polynomials  as  shown  in  figure  IV-1B.  It  is 
this  curve  which  constitutes  the  standard  against  which  other  models  are  compared 
for  Case  4.  The  decision  to  utilize  a single  polynomial  from  0 to  35  kyd  is  due  to 
the  unstable  nature  of  the  nearfield  interference  patterns  as  described  above.  How- 
ever, if  a user  were  to  decide  that  features  of  this  size  are  of  significance,  the 
use  of  up  to  10  polynomials  in  this  region  would  be  indicated.  The  choice  of  a 
single  polynomial  fit  to  the  FFP  in  this  range  interval  led  to  smaller  differences 
between  the  FFP  and  several  models  than  would  have  resulted  from  a more  complex 
representation.  This  was  due  to  the  lack  of  well  defined  features  in  many  outputs 
(particularly  when  incoherent  phase  addition  was  utilized) . 

Figure  IV-2A  (showing  CONGRATS  V results)  is  sufficiently  similar  to  the  FFP 
output  just  discussed  so  that  similar  choices  regarding  polynomial  fittings  were 
made,  resulting  in  figure  IV-2B.  In  looking  at  the  difference  curve  in  figure  IV- 
2C,  sharp  oscillations  are  observed  between  60  and  80  kiloyards;  these  are  due  to  a 
range  discrepancy  between  the  convergence  zones  predicted  by  the  FFP  and  those  pre- 
dicted by  CONGRATS  V (coherent).  When  the  mean  and  standard  deviation  of  the 
difference  curve  are  calculated  in  an  instance  such  as  this  (i.e.,  range  displacement 
of  features  which  otherwise  closely  agree),  it  is  found  that  the  mean  is  nearly 
[ zero  and  the  standard  deviation  is  large.  That  this  is  indeed  the  case  is  seen  in 

table  C4  (of  appendix  C)  for  the  CONGRATS  V coherent  model  in  the  60-80  kyd  interval 
(u  = 0,  o = 6.3).  Figure  IV-2D  shows  the  CONGRATS  V incoherent  output  to  have  a 
single  major  feature,  the  convergence  zone.  This  CZ  is  single  lobed  (unlike  the 
FFP)  but  agrees  quite  well  in  range  extent  as  measured  at  the  90  dB  level;  however, 
the  "bottom  bounce  region"  between  35  and  58  kyd  in  the  FFP  output  is  almost  com- 
pletely absent  here.  These  factors  explain  the  character  of  figure  IV-2E. 

FACT  (coherent)  output  in  figure  IV-3A  shows  sufficient  structure  so  that  four 
polynomials  were  chosen  to  represent  the  mean  (figure  IV-3B) . The  very  abrupt 
change  in  propagation  loss  at  86  kyd  (a  feature  also  seen  in  figure  IV-3D  and 
present  in  all  FACT  outputs),  has  been  smoothed  by  the  polynomial.  The  difference 
curve  figure  IV-3C  shows  a large  error  at  38  kyd;  this  is  due  to  the  bottom  bounce 
region  as  predicted  by  FACT  (coherent)  occurring  at  larger  ranges  than  predicted 
by  FFP.  In  the  range  interval  between  60  and  80  kyd,  differences  arise  due  to  an 
extension  of  the  CZ  to  shorter  ranges  by  the  FACT  model  as  compared  to  FFP  and  to 
the  absence  of  a deep  notch  in  the  CZ  structure  of  the  FACT  output.  FACT  (inco- 
herent) output,  shown  in  figure  IV-3D,  shows  the  bottom  loss  feature  to  exhibit 
lower  loss  and  to  be  found  at  greater  range  as  compared  with  the  FACT  (coherent  out- 
put). Differences  from  the  FFP  in  figure  IV-3E  reflect  these  changes  when  compared 
with  figure  IV-3C. 

Figures  IV-4A,  IV-4B,  and  IV-4C  show,  respectively,  the  NISSM  II  (coherent) 
output,  a four  polynomials  fit  to  the  output,  and  the  difference  between  the  FFP 
analytic  fit  and  the  NISSM  II  (coherent)  analytic  fit.  The  only  area  of  large 
differences  is  the  convergence  zone  region;  NISSM  II  (coherent)  gives  a CZ  which 
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lacks  a deep  notch,  is  narrower  than  the  CZ  of  FFP,  beginning  at  a greater  range 
and  terminating  at  a shorter  range,  and  exhibits  greater  loss  than  the  CZ  of  FFP. 

The  NISSM  II  (incoherent)  output  of  figure  IV-4D  shows  a vestigial  bottom  bounce 
feature  and  a CZ  somewhat  broader  (at  the  zone  termination)  as  compared  with  the 
coherent  results.  The  differences  between  the  analytic  fit  to  FFP  and  the  NISSM  II 
(incoherent)  results  are  presented  in  figure  IV-4E.  The  large  differences  between 
50  and  60  kyd  are  due  to  the  low  losses  of  NISSM  II  (incoherent)  in  a region  which 
for  the  FFP  is  between  the  end  of  the  bottom  bounce  region  and  the  start  of  the  CZ. 

The  RAYMODE  IV  (coherent)  output  lacks  clearly  defined  major  features  (see 
figure  IV-5A).  However,  using  the  knowledge  of  major  features  from  the  standard 
(i.e.,  the  analytic  fit  to  the  FFP),  five  polynomials  were  used  to  obtain  the  analy- 
tic fit  to  the  RAYMODE  IV  (coherent)  results,  shown  in  figure  IV-5B.  Despite  the 
choice  of  an  analytic  fit  most  faithful  to  the  standard,  the  differences  of  figure 
IV-5C  are  seen  to  be  large  in  all  areas.  The  RAYMODE  IV  (incoherent)  results 
(figure  IV- 5D)  show  a single  major  feature,  the  convergence  zone,  which  is  broader 
and  shows  greater  loss  than  the  FFP  and  lacks  a deep  notch.  The  nature  of  the  CZ 
and  the  absence  of  a bottom  bounce  feature  in  the  RAYMODE  IV  (incoherent)  output 
accounts  for  the  large  differences  observed  between  40  and  80  kyd  in  figure  IV-5E. 

The  RAYMODE  X (coherent)  output  and  the  analytical  fit  (5  polynomials)  to  this 
output  are  shown  in  figures  IV-6A  and  IV-6B,  respectively.  The  only  area  of  large 
differences  between  the  FFP  analytic  fit  and  the  RAYMODE  X (coherent)  analytic  fit 
is  in  the  convergence  zone.  The  zone  as  given  by  RAYMODE  X (coherent)  is  narrow, 
shows  greater  loss  and  has  a poorly  defined  notch  as  compared  with  the  FFP  conver- 
gence zone,  thus  accounting  for  the  differences  in  figure  IV-6C.  The  RAYMODE  X 
(incoherent)  results  of  figure  IV-6D  show  a convergence  zone  and  no  bottom  bounce 
region.  The  resulting  differences  with  respect  to  the  analytic  fit  to  the  FFP  are 
large,  as  shown  in  figure  IV-6E. 

As  described  above,  the  difference  curves  were  subdivided  into  20  kiloyard 
intervals  and  the  mean  (y)  and  standard  deviation  (a)  of  the  differences  were  com- 
puted in  each  interval  as  well  as  for  the  entire  100  kiloyard  range  extent.  Thus, 
the  information  contained  in  the  10  difference  curves  for  Case  4 is  condensed  and 
presented  in  a single  table,  specifically  table  C4.  Table  7,  giving  the  weights  to 
be  used  for  different  intervals  of  |y|  and  o was  then  applied  to  the  results  of 
table  C4  resulting  in  the  further  condensation  of  information  (table  C13D). 

Finally,  upon  averaging  these  data  with  the  data  from  Cases  1,2, 3, 5 and  6 over  all 
ranges,  the  final  result,  that  of  table  9 is  obtained. 

The  tables  mentioned  above  are  of  primary  use  in  comparing  candidate  models 
with  a standard  for  an  assessment  of  accuracy.  Given  that  a specific  model  has 
achieved  an  overall  cumulative  measure  of  accuracy  which  is  acceptable  to  the  user 
(as  obtained  from  table  9)  it  may  be  desired  to  focus  upon  the  accuracy  of  this 
model  for  the  various  case/range  interval  combinations.  Such  results  are  found  in 
appendix  D (e.g.,  table  D6-A  forthe  RAYMODE  X (coherent)  model).  From  a table  such 
as  this,  the  accuracy  of  a model  is  revealed  from  the  viewpoint  of  consistency . Also , 
case/range  interval  bins  for  which  the  model  is  not  sufficiently  accurate  (accord- 
ing to  criteria  designated  by  the  user)  are  readily  identified. 
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COMPUTER  RUN  TIME  REQUIREMENTS 


Program  running  time  is  a factor  that  determines  whether  a program  is  suitable 
for  a given  application.  For  example,  a transmission  loss  model  to  be  used  in  a 
sonar  trainer  must  be  capable  of  producing  a result  in  a matter  of  seconds;  this  is 
also  true  if  such  a model  is  utilized  for  sonar  mode  selection  or  tactical  decision 
making.  On  the  other  hand,  running  time  requirements  can  be  significantly  relaxed 
if  the  model  is  to  be  used  for  making  predictions  relating  to  sonar  design  concept 
formulation  or  evaluation  and  for  other  research  oriented  tasks. 

The  computer  run  times  for  the  models  as  utilized  in  the  comparison  studies 
are  given  in  tables  1 1 A and  1 1 B . It  should  be  noted  that  models  used  in  this  study 
may  not  have  been  programmed  to  optimize  running  time.  The  running  times  are  those 
obtained  from  executing  the  models  as  available  at  the  Naval  Underwater  Systems 
Center  on  the  UNIVAC  1108  computer.  Table  11A  gives  the  run  times  for  each  of  the 
models  as  run  on  the  UNIVAC  1108  computer  without  normalization  based  upon  the 
number  of  points  generated  by  the  given  model.  Table  1 1 B presents  run  times  normal- 
ized to  a prediction  containing  100  points.  This  latter  table  was  calculated  since 
the  run  times  are  approximately  proportional  to  the  number  of  points  generated  by 
a model  and,  therefore,  a direct  comparison  between  the  times  listed  in  table  11A 
could  be  misleading.  As  presently  programmed,  the  NISSM  II  and  CONGRATS  V models 
do  not  have  the  numbers  of  points  per  prediction  as  a user  option;  for  these  models 
the  number  of  points  is  fixed  at  128  and  256,  respectively.  This  does  not  imply 
that  these  numbers  cannot  be  changed  or  made  user  options,  but  rather  that  such 
changes  would  be  made  at  a program  level  beyond  that  intended  for  the  typical  user. 
Despite  the  fact  that  the  numbers  of  points  per  prediction  are  fixed  for  NISSM  II 
and  CONGRATS  V and,  hence,  the  running  times  given  in  table  11B  are  unachievable  by 
these  models  as  presently  programmed,  a normalized  comparison  was  nonetheless  deemed 
useful  and,  therefore,  included. 

For  other  models  constituting  the  comparison  study,  the  number  of  points  per 
prediction  is  a user  option  up  to  a maximum  allowable  value;  for  FACT  the  maximum 
number  of  points  is  250  and  for  RAYMODE  IV  and  RAYMODE  X a maximum  of  400  points 
may  be  generated.  As  typically  used,  the  FFP  generates  8192  points  of  which  4096 
are  eliminated  due  to  aliasing.  Although  the  FFP  may  generate  a prediction  con- 
taining 2^  points,  a choice  of  M which  is  small  (e.g. , M=7)  may  seriously  affect 
the  accuracy  of  the  prediction  and  is  not  recommended. 

To  a certain  degree,  accuracy  may  be  traded  off  against  running  time  or,  its 
counterpart,  the  number  of  points  per  prediction.  Thus,  had  the  models  herein  re- 
ported been  run  so  as  to  produce  the  same  number  of  points  (implying  the  run  times 
of  table  11B)  the  results  relating  to  accuracy  might  have  been  different. 

A few  comments  related  to  the  contents  of  table  1 1 A are  in  order:  (1)  only 

the  total  run  time  was  available  for  CONGRATS  V.  (2)  The  CONGRATS  V run  time  in- 
cludes an  estimated  5 seconds  required  for  plot  related  calculations.  (3)  For  most 
of  the  models,  the  run  time  for  Case  8 was  unavailable.  In  such  cases,  a run  time 
equal  to  that  for  Case  5 (the  parameters  of  which  are  closest  to  Case  8)  was  assumed. 
(4)  Only  Case  7 and  Case  8 were  run  using  the  FFP  to  construct  a one-third  octave 
prediction  by  averaging  several  CW  predictions.  Approximately  10  seconds  should 
be  added  to  the  run  times  of  each  case  for  averaging  of  the  components  required  for 
the  final  result. 
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The  normalized  computer  run  times  as  given  in  table  1 1 B fall  into  three  cate- 
gories: Category  I consists  of  those  models  for  which  the  maximum  time  for  any 

given  case  was  less  than  or  equal  to  four  seconds  and  the  total  run  time  was  less 
than  30  seconds;  Category  II  for  which  individual  case  run  times  varied  between 
8 and  30  seconds  and  the  total  run  time  was  between  1 and  2 minutes;  Category  III 
for  which  run  times  for  individual  cases  varied  between  6 seconds  and  3 minutes 
and  the  total  run  time  was  greater  than  5 minutes.  The  models  fell  into  the  three 
categories  as  follows: 

I FACT 

RAYMODE  X 

1 1 CONGRATS  V 

NISSM  II 
RAYMODE  IV 
III  FFP  (CW) 

FFP  (1/3-octave)  was  not  included  in  a category  since  the  use  of  FFP  in  this 
manner  represents  a special  application. 
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Table  HA.  Computer  Run  Time 


X 


o 


Q 

”0 

rr 

LO 

r- 

\0 

00 

Ovl 

£ 

o 

o 

o 

o 

o 

o 

o 

rr 

o 

o 

o 

o 

o 

o 

o 

o 

2 

o 

> 

•— • 

0 

00 

f-H 

o 

r- 

Tf 

Oi 

r}- 

to 

U4 

• 

• 

• 

• 

• 

• 

X 

oo 

LO 

o 

C T> 

oo 

CTi 

cn 

§ 

CM 

rj 

rvi 

o 

o 

o 

LO 

o 

o 

o 

o 

o 

o 

o 

XL 

1 

t— i 

o 

vD 

f- 

1—4 

o 

a> 

o 

to 

C/5 

or 

(N 

OJ 

f-H 

(M 

LO 

CO 

■— < 

r“H 

F— « 

r— ( 

•— < 

rH 

CnI 

►— t 

• > 

■ * 

• • 

. . 

z 

o 

o 

o 

o 

o 

o 

o 

’-0 

o 

H 

■j 

■M 

0 

> 

03 

03 

03 

03 

03 

00 

*— t 

CT) 

•0 

oj 

(NJ 

CL  U 

u.  o 

1 

1 

■ 

1 

<N 

sO 

CL  I 

■ ■ 

i—4 

to 

tO 

1 

■ 

m 

1 

OJ 

•— < 

v / 

0 

»— « 

o 

o 

or 

a> 

rr 

oo 

a.  C1 

o 

00 

00 

a> 

00 

00 

St  u 

to 

o 

04 

to 

.. 

to 

to 

H 

to 

X> 

x 

rO 

to 

f-H 

CM 

00 

CM 

LO 

to 

»—♦ 

o 

rO 

to 

to 

K9 

00 

u 

>— < 

r— 4 

*—H 

»-h 

Rfl 

00 

< 

o 

o 

o 

O 

o 

o 

kJ 

o 

o 

o 

o 

o 

o 

o 

o 

■ 

o 

> 

c3 

03 

03 

03 

03 

CS 

CO 

to 

E— 

< 

rsi 

C D 

Z 

o 

u 

o 

■I 

u 

03 

CO 

X 

• 

•* 

z 

>“-« 

oj 

to 

-r 

l o 

X> 

00 

t— I 

— s: 

0 

0 

0 

0 

0 

0 

0 

03  .. 

to 

C/l 

t/> 

l/l 

t/1 

•J) 

t /> 

oc 

03 

03 

03 

03 

n 

03 

03 

o x 

■ 

u 

U 

U 

u 

u 

U 

U 

0 

a 


0 

a 


oo 

c 

•H 

oo 

03 

u 

0 

> 

03 

03 

0 

Jh 

3 

O' 

0 

0 

03 

3 

>-H 

0 

c 


L-> 

+->  o 
c 

+-> 

o o 

— < 03 

CL 

c/1 

oo  0 

C 3 

•H  • r-4 

03  03  03 
3 0 > 

-H  CO 

0 3 

C 

•H  (/)  00 

03 

- 5 03 
0 C 
E LO  03 
•H 

•m  0 

to 

/“N  03  V3 
♦->0  0 
(0 
03 
0 


C 

3 


oo 


(O 

t/1 

0 

0 

O 

u 

CL 


03 

• c 
0 0 
*3  U 

w 

03 

— 13 
CL 
03  U 
> 
o3 

03 

4->  L> 

o o 

Z H 


C 

•H 

X 


c 

00  o 
c 

•H  03 
C 0 

c </> 

3 3 
DC 

0 

• > 
0 03 

— t 4-» 

-O  0 
03  O 

f—»  | 

• iH  ro 
03  \ 
> -H 
03  w 

♦->  O. 
O CL 
Z U- 


03  XL  0 03 


24 


Normalized  to  a 100  Point  Prediction 


STORAGE  RF.QU  I REMENTS 


The  UNIVAC  1108  storage  requirements  for  the  various  models  constituting  this 
study  arc  given  in  table  12.  The  reader  is  cautioned  that  models  have  been  opti- 
mized in  terms  of  storage  requirements  to  varying  degrees.  The  values  in  the  table 
pertain  to  versions  of  the  models  available  at  the  Naval  Underwater  Systems  Center. 

Table  12  is  divided  into  two  groups.  The  upper  group,  except  as  otherwise 
indicated,  does  not  include  the  storage  required  for  plot  routines  and  plot  related 
instructions.  The  values  shown  for  NISSM  II,  while  they  do  not  include  the  storage 
required  by  the  plot  subroutines,  do  include  storage  for  the  plot  instructions  and 
buffer.  The  latter  two  account  for  approximately  ten  percent  of  the  storage  re- 
quirement of  NISSM  II.  Storage  requirements  are  not  shown  for  the  FFP  (1 /3-octave) , 
inasmuch  as  it  repeatedly  uses  the  FFP  in  generating  its  predictions.  The  only 
available  storage  requirements  for  CONGRATS  V included  plot  routines  and  these  are 
shown  in  the  lower  group  of  table  12.  A corresponding  set  of  numbers  is  shown  for 
NISSM  II  for  comparison  purposes. 

The  results  of  table  12  may  be  summarized  by  placing  models  into  one  of  three 
categories : 

Category  1 - Storage  requirements  between  8K  and  16K  locations; 

Category  II  - Storage  requirements  between  16K  and  32K  locations; 

Category  III  - Storage  requirements  between  32K  and  64K  locations. 

The  models  fell  into  categories  as  follows: 


I 

RAYMODE  X 

RAYMODF.  IV 

II 

FACT 

III 

NISSM  II 

CONGRATS  V 

FFP 
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Table  12.  Storage  Requirements 


EASE  OF  I MP  LEMENTA  T I ON 


The  ease  with  which  a program  can  be  implemented  on  a given  computer  is  re- 
vealed in  a number  of  ways: 

(1)  Contact  with  the  author  or  a cognizant  individual  or  code  with  broad 
experience  relating  to  the  program  is  the  most  direct  approach.  For  the  programs 
used  in  this  report,  sucli  a list  of  individuals  and  codes  is  given  in  table  13. 

(2)  Before  consulting  with  the  author  of  a program  regarding  its  implementa- 
tion on  a given  computer  it  is  useful  to  know  which  computers  already  have  the  pro- 
gram running  and  for  what  type  of  machines  minor  program  modifications  will  be  re- 
quired. 

All  transmission  loss  programs  used  in  this  report  are  written  in  FORTRAN  and 
are  easily  adaptable  to  any  computer  with  a FORTRAN  compiler.  Only  slight  modifi- 
cations are  sometimes  required  if  the  wordlength  (in  bits)  of  the  prospective  com- 
puter is  different  from  that  of  the  original. 

A.  FFP  — Following  is  a list  of  installations  to  which  the  FFP  program  has 

been  sent,  and,  where  known,  the  type  of  computer  involved.  It  is 

presumed,  but  not  known,  that  the  FFP  model  has  actually  been  imple- 
mented at  these  installations. 

a)  Honeywell,  West  Covina,  CA.  (IBM) 

b)  Acoustic  F.nvironmental  Support  Detachment  (CDC) 

c)  Naval  Intelligence  Support  Center,  Suitland,  MD.  (Xerox  Sigma) 

d)  Canadian  Defence  F.stabl ishment , Nova  Scotia 

e)  Acoustic  Research  Laboratory,  University  of  Texas  (CD C 6600) 

B.  CONGRATS  V --  Still  in  process  of  development. 

C.  FACT  --  computers  on  which  the  FACT  program  has  been  implemented  include: 

CDC  1700,  3000  and  6000  series  and  CDC  7600 

Honeywell  Minicomputers 

XDS-7 

POP- 1 1,  scries 
NOVA  series 

Program  Requirements:  5 1/2  significant  digits  in  the  mantissa  (floating 

point).  This  requirement  is  met  by  all  16-bit  machines.  Thus  the  program  can  be 
used  directly  on  machines  with  16-bit,  floating  point  hardware  (minor  modifications 
are  required  for  use  on  other  than  CDC-6000  series).  The  program  can  be  modified 
for  use  on  non- 16-bit  machines.  Futher  information  can  be  obtained  from  NORDA, 

Code  32. 

D.  NISSM  II  --  This  program  has  been  implemented  "all  over  the  world  on  many 
different  types  of  computers"  according  to  Dr.  H.  Weinberg,  author  of  the  program. 

No  record  has  been  kept  of  the  many  places  to  which  copies  of  the  program  have  been 
sent.  It  can  be  used  on  any  FORTRAN  computer,  with  minor  modifications  required 
for  non-36-bit  machines. 

E.  RAYMODE  IV  --  In  practice  has  been  replaced  by  RAYMODE  X. 
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F.  RAYMODE  X is  available  at  the  following  facilities: 


Faci lity 

Computer 

NUSC/NLL 

UN I VAC  1108 

Singer  Corp. , Silver  Spring,  MD. 

UN  I VAC  1108 

NUC,  San  Diego,  CA. 

UN  I VAC  1108 

Edo  Corp.,  College  Point,  NY. 

UYK-20 

NUSC/NLL 

UP  9830 

*NUSC/NLL 

HP  9830 

COMTHIRDFLT 

HP  9830 

COMCRUDESGRU  TWO/DESDEVGRU 

HP  9830 

*USS  MOINESTER  (FF  1097) 

HP  9830 

**NUSC/NLL 

DEC  PDP  11 

**USS  C0NN0LE  (FF  1056) 

DEC  PDP  11 

* Modified  for  shipboard  use. 

**  SIMAS  Version. 

(3)  For  several  reasons,  one  should  be  familiar  with  reference  material  re- 
garding a given  model  before  a commitment  to  program  implementation  is  made.  Accord- 
ingly, a list  of  references  has  been  provided  (see  p.  49)  for  the  transmission  loss 
models  used  in  this  report.  CONGRATS  V is  in  the  process  of  development  and,  there- 
fore, no  documentation  is  available. 


Table  13.  Points  of  Contact  for  Information 
Relating  to  Transmission  Loss  Models 


CONCRATS  V 

: Dr.  H.  Weinberg 

Code  314 

New  London  Laboratory 

Naval  Underwater  Systems  Center 

New  London,  CT.  06320 

Tel.  (203)  442-0771,  Ext.  2589 

FACT 

: Code  32 

Naval  Ocean  Research  and  Development 
Activity 

National  Space  Technology  Laboratories 
Bay  St.  Louis,  MS.  39520 

FFP 

: Dr.  F.R.  DiNapoli 

Code  3123 

New  London  Laboratory 

Naval  Underwater  Systems  Center 

New  London,  CT.  06320 

Tel.  (203)  442-0771,  Ext.  2647 

NISSM  II 

: Thelda  Garret 

Code  314 

New  London  Laboratory 

Naval  Underwater  Systems  Center 

New  London,  CT.  06320 

Tel.  (203)  442-0771,  Ext.  2991 

RAYMODE  IV 

: Dr.  G.  Leibiger 

Code  222 

New  London  Laboratory 

Naval  Underwater  Systems  Center 

New  London,  CT.  06320 

Tel.  (203)  442-0771,  Ext.  2221 

RAYMODE  X 

: Same  as  RAYMODE  IV  (above) . 

COMPLEXITY  OF  PROGRAM  EXECUTION 


The  complexity  of  program  execution  is  best  revealed  by  listing  the  inputs 
required  in  order  to  run  the  program.  Programs  differ  widely  in  their  degree  of 
complexity;  this  largely  reflects  the  number  of  decisions  left  under  the  user's 
control.  For  example,  in  a program  utilizing  ray  theory,  required  inputs  include 
the  total  angular  extent  of  rays  emanating  from  the  source  and  the  angular  differ- 
ence between  adjacent  rays.  These  inputs  are  best  decided  independent  of  the  user 
in  applications  such  as  transmission  loss  computations  for  use  aboard  ship  or  in  a 
sonar  trainer.  On  the  other  hand,  it  is  advantageous  to  allow  these  inputs  to  be 
under  user  control  if  the  program  is  to  be  used  in  a Navy  Rf)D  laboratory  where  re- 
quirements are  likely  to  be  variable,  or  if  the  program  is  to  be  used  in  making 
predictions  for  sonar  systems,  existing  and  proposed,  or  if  the  environmental 
scenarios  may  have  unusual  aspects.  Thus,  the  desirable  level  of  complexity  is 
dependent  upon  the  application.  Following  are  the  input  requirements  for  the  models 
constituting  this  study. 


A.  CONGRATS  V - Input  requirements  are  identical  to  those  for  NISSM  II  (see  below). 

B.  FACT  - As  described  in  reference  2,  "THE  CARD  INPUTS  TO  LOSS  ARE  DETAILED  IN 
THE  COMMENTS  WITHIN  THAT  PROGRAM,  AND  REPEATED  HERE  FOR  REFERENCE  PURPOSES." 


CARD 

DATA 

FORMAT 

1 

TITLE 

8A10 

2 

3A,B, . . . 


4 

5 

6 


(EOF  ENDS  RUN) 

N,IL,IB,IW,IPL, IAR 
Z ( I ) ,C(I)  (1=1, N) 

OR  D ( I ) ,T(I) ,S(I) 
NR.ORNMI 
F(I)  (1=1,6) 
S,R,JC(I)  (1=1,6) 


615 

8F10.2 

3 (F8 . 2 , F6 . 2 , F6 . 2) 
15 , 5X , F10 . 2 
6F10.2 
2F10. 2,615 


(EOF  ENDS  RUN) 

(S.GE.  10E6  GOES  BACK  TO  READ  CARD  1) 
FACTTL  CALLED  TO  COMPUTE  I.OSSES 
LOSSES  PRINTED  AND/OR  PLOTTED 
(GOES  TO  READ  CARD  6) 
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N IS  NO.  OF  PROFILE  POINTS  2.LE.  (ABS(N)).LE.  SO 

*FOR  N POSITIVE,  PROFILE  IS  INPUT  DIRECTLY  IN  DEPTH, 

VELOCITY  PAIRS,  4/CARD.  A VELOCITY  .LT.  3000  IS  USED  AS  AN 
INDICATOR  OF  METRIC  INPUT  (M,M  PER  S) . BOTH  DEPTHS  + VELOCITIES 
ARE  CONVERTED  TO  ENGLISH  UNITS  (FT, FT  PER  SEC). 

*FOR  N NEGATIVE,  PROFILE  IS  INPUT  AS  DEPTH,  TEMP., 

SALINITY  TRIPLETS,  3/CARD.  METRIC  UNITS  ARE  ASSUMED  (M,CENT,PPT) . 
WILSONS  FORMULA  IS  USED  TO  COMPUTE  VELOCITIES,  DEPTHS  + 

VELOCITIES  ARE  THEN  CONVERTED  TO  ENGLISH  UNITS. 

*THE  INPUT  PROFILE  IS  ALWAYS  PRINTED,  IF  CALCULATIONS  + 

CONVERSIONS  ARE  REQUIRED,  THE  RESULTING  VALUES  ARE  ALSO  PRINTED. 
*THE  BOTTOM  DEPTH  IS  ALWAYS  Z(N) 

IL  IS  THE  INDEX  OF  THE  MIXED  LAYER  DEPTH  IN  THE  INPUT  PROFILE  (SEPARATE 
COMPUTATIONS  ARE  THEN  PERFORMED  FOR  A SURFACE  DUCT  OF  THIS 
DIMENSION  AND  NO  RAYS  ARE  TRACED  IN  THE  DUCT).  EITHER  1 
OR  0 CAN  BE  USED  TO  INDICATE  THAT  NO  LAYER  IS  PRESENT. 

0 .LE.  IL  .LE.  (ABS(N) ) . IL  = (ABS(N))  INDICATES  THAT  A 
HALF-CHANNEL  CONDITION  IS  PRESENT  AND  THAT  THE  ROUTINE 
HFCHTL  (NORMALLY  USED  ONLY  FOR  ASRAP)  SHOULD  BE  USED. 

IB  IS  THE  BOTTOM  TYPE 

A NEGATIVE  VALUE  INDICATES  THAT  THE  USER  WILL  SUPPLY  A BOTTOM  LOSS 
FUNCTION,  AND  MODIFY  FUNCTION  BOTTOM  TO  CALL  THE  REPLACEMENT  FOR 
THE  DEFAULT  FUNCTION  BTMLOS. 

1-9  INDICATES  FNWC  BOTTOM  LOSS  FUNCTIONS 
IW  IS  THE  WAVE  HEIGHT  IN  FEET 
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IPL  IS  THE  PRINT/PLOT  INDICATOR 

0..  PRINT  ONLY  (CD.  LOSS  VS.  RANGE) 

1..  PAGE  PLOT  ONLY  (DB.  LOSS  VS.  RANGE,  1 PAGE/ FREQUENCY) 

2..  PRINT  AND  PLOT  (=0  PLUS  1) 

-1..  PAGE  PLOT  ONLY  (DB.  LOSS  VS.  RANGE,  ALL  FREQS.  ON  SAME  PLOT) 
-2..  PRINT  AND  PLOT  (=0  PLUS  -1) 

IAR  IS  THE  ARRIVAL  CALCULATION  INDICATOR 
0 . . NO  ARRIVALS 

1..  ARRIVAL  ANGLES  VS.  RANGE  CALCULATED  AND  PLOTTED 
NR  IS  THE  NUMBER  OF  RANGE  POINTS  1 .LE.  NR  .LE.  250 
DR  IS  THE  INCREMENTAL  (AND  FIRST)  RANGE  IN  N.MI. 

F( I ) ARE  THE  FREQUENCIES  - UP  TO  SIX  - IN  HERTZ 
S IS  THE  SOURCE  DEPTH  IN  FEET. 

R IS  THE  RECEIVER  DEPTH  IN  FEET. 

*IF  EITHER  SOURCE  OR  RECEIVER  DEPTH  IS  OUTSIDE  THE  PROFILE 
LIMITS  (LESS  THAN  ZERO  OR  GREATER  THAN  Z(N))  THE 
SOURCE  OR  RECEIVER  IS  BOTTOMED. 

JC(I)  ARE  THE  COHERENCY  INDICATORS,  AND  CORRESPOND  TO  THE  F(I)S  1-TO-l 

0 = SEMI -COHERENCE 

1 = INCOHERENCE 

2 = FULL  COHERENCE 

*THE  VALUES  OF  JC(I)  ARE  NORMALLY  LEFT  BLANK  TO  INDICATE  THAT 
SEMI -COHERENCE  IS  TO  BE  USED  FOR  ALL  FREQUENCIES." 
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C.  FFP 


Card  No. 

Column  Nos. 

Field  Symbol 

Format 

1 

1-72 

TITLE 

18A4 

An  alpha- 

numeric  title  specified  by  the  user. 

-> 

1-10 

F (frequency  Hz) 

E10.4 

11-20 

CO  (surface  velocity)  ft/sec. 

II 

21-30 

ZZR  (receiver  depth)  ft. 

?» 

31-40 

ZZS  (source  depth)  ft. 

II 

41-42 

LAYER  (number  of  water  layers) 

II 

43-44 

ICO  =0  1 RUN 

^ 0 loop  program  to  card  2 

12 

3 

1-20 

Z(I+1)  (layer  depths)  ft. 

E20.8 

21-40 

AAH(I)  (Hj  for  Jth  layer) 

II 

The 

number  of 

information  on  this  set  of  cards  is  obtained  from  subroutine 
cards  in  the  set  corresponds  to  LAYER. 

PROFIT.  The 

4 

1-10 

RO  (starting  point  in  range, 

E10.8 

ft.)  arbitrary 

11-20 

PRATIO  (density  of  first  bottom 

ii 

layer/density  of  water) 

21-23 

M size  of  FFP  (2M=N) 

12 

23-24 

LPRINT  = 1 additional  checkout 

it 

prints 

= 2 normal  print  output 

25-26 

LDELTA  should  always  be  set  = 1 

ti 

5 

1-5 

IP  number  of  times  the  FFT  is 

15 

collapsed,  IP  = 1 no  collapsing 

The  quantity  N=2M  is  the  size  of  the  FFT  used  in  the  program  (i.e.,  the  total 
number  of  range  points  at  which  predictions  for  propagation  loss  will  be  obtained 
of  which  only  the  first  N/2  values  are  to  be  considered  valid  due  to  aliasing). 
Most  computers  have  a maximum  array  size  (e.g.,  on  the  NUSC  UNIVAC  1108  this  is 
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8192  or  M=13).  The  FFP  is  dimensioned  to  this  maximum  size. 

In  some  instances  it  is  necessary  to  include  more  samples  than  can  be  accommo- 
dated by  the  maximum  array  size  allowed  to  achieve  an  accurate  answer.*  This  is 
accomplished  by  utilizing  a collapsing  technique.  The  input  parameter  which  con- 
trols this  option  is  IP.  If  IP=1,  N samples  will  be  transformed  resulting  in  N 
answers  for  propagation  loss  versus  range.  If  IP  is  set  greater  than  1,  then  in 
effect  IP*N  samples  will  be  transformed,  again  resulting  in  N answers.  This 
technique  can  be  of  great  advantage  when  the  FFP  is  run  on  computers  with  limited 
memory  location.  If  for  example  the  maximum  allowed  array  size  is  1024  and  it  is 
determined  that  16,384  samples  are  required  then  IP  should  be  set  to  5. 


The  FFP  program  automatically  sets  A£,  the  spacing  between  input  samples, 
equal  to  the  reciprocal  of  Hmax,  a scale  factor  used  in  the  process  of  fitting  the 

sound  speed  profile.  The  important  information  in  the  integration  process  is  found 
for  the  values  of  £ smaller  than  the  wave  number  corresponding  to  the  slowest  sound 
speed,  C . , associated  with  the  problem.  Then 


£ 

max 


2irf/C 


min 


+ 10  A£  . 


The  last  term  is  added  as  an  insurance  factor.  The  smallest  wave  number,  £ 
considered  is  then  determined  by  a choice  for  N and  IP  according  to  min 


C . = C - (IP*N-1)*A£ 

min  max  v 

1-10 


AKI  (sound  speed  in  first  bottom 


E10.4 


layer,  ft/sec) 

11-20  AK  (sound  speed  in  second  bottom 

layer,  ft/sec) 


21-30  ALPHAB  .(attenuation  in  both 

bottom  layers,  dB/ft) 

31-40  DENSR  (density  in  first  bottom 

layer/density  in  second  bottom 


layer) 

41-50  THICK  (thickness  of  first  bottom  " 

layer,  ft) 

* If  N is  not  chosen  sufficiently  large,  the  answers  will  be  in  error  from  the 
source  up  to  some  range  which  is  difficult  to  determine  beforehand.  If  a question 
exists  about  the  size  of  N,  the  program  can  be  rerun  with  N doubled,  and  the  new 
results  examined  at  the  close  ranges  to  see  if  they  have  significantly  changed. 

With  a little  experience  the  user  can  easily  determine  whether  N is  too  small, 
since  then  the  results  at  the  close  ranges  will  yield  uncharacteristically  high 
propagation  loss  values  whereas  for  slightly  larger  ranges  the  values  of  propagation 
loss  will  be  reasonable. 
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This  last  card  gives  the  information  about  the  ocean  bottom.  It  is  assumed 
that  a two  layered  bottom  is  sufficiently  general.  Additional  layers  can  be  added 
with  a minor  change  in  subroutine  BOTTOM.  If  AK1=AK2  and  DENSR=1  the  two  layered 
bottom  reduces  to  a semi-infinite  bottom. 

The  program  provides  N answers  for  propagation  loss  at  the  ranges 

r =r  +(m-l)  Ar  m=0, 1,2. . . ,N-1. 

mo 

Only  the  first  N/2  are  considered  valid  due  to  aliasing.  The  spacing  between 
points,  Ar  is  automatically  determined 

2n  2n 

r NA£  - N max 

where  AC  in  an  increment  of  wavelength  (i.e.,  the  resolution  Ar  is  proportional  to 
the  inverse  of  the  record  length  in  wavelengths). 

D.  NISSM  II  - Table  14  (table  7 of  reference  6)  is  a sample  deck  which  will 
result  in  the  production  of  a sound  speed  profile,  ray  diagram,  and  transmission 
loss  for  two  target  depths.  Included  in  reference  6 is  a table  citing  default  values 
for  the  various  parameters  required  by  the  NISSM  II  program.  Card  formats  are  also 
given  as  are  options  relating  to  input  tables  such  as  attenuation  coefficient  vs. 
frequency.  Since  NISSM  II  is  a system  performance  model,  input  tables  describing 
variables  such  as  transmitter  response  and  volume  scattering  strength  are  provided 
for  as  are  parameters  such  as  bandwidth,  pulse  length  and  target  strength.  As 
demonstrated  by  the  sample  deck  of  table  14  it  is  not  necessary  to  specify  system 
variables  for  the  computation  of  transmission  loss  versus  range.  The  length  and 
complexity  of  the  inputs  required  by  NISSM  II  (necessitated  by  its  being  a system 
performance  model)  preclude  a complete  listing  of  input  variables,  options  and  card 
formats.  These  are  described  in  detail  in  reference  6. 
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Table  14. 


Input  Deck  for  Computing  Propagation 
Loss  versus  Range 


A XQT  NISSM2 
COMMENT 


TYRRHENIAN  SEA-JUNE  1969 


A EOF 

RANGE  AXIS 
DEPTH  AXIS 
VELOCITY  AXIS 

VELOCITY  PROFILE 

FT 

DEG  F 

/1000 

0.0 

71.8 

38.25 

16.0 

71.3 

38.24 

25.0 

70.8 

38.23 

50.0 

70.7 

38.20 

65.0 

70.6 

38.16 

100.0 

62.5 

38.11 

150.0 

60.2 

38.06 

175.0 

58.0 

38.00 

200.0 

57.6 

38.00 

300.0 

56.9 

38.09 

400.0 

57.2 

38.29 

500.0 

57.4 

38.38 

1500.0 

57.2 

38.62 

2500.0 

56.5 

38.55 

4000.0 

56.0 

38.48 

6000.0 

56.0 

38.40 

9840.0 

56.0 

38.40 

A EOF 

BOTTOM  DEPTH 
BOTTOM  LOSS 
FREQUENCY 
SONAR  DEPTH 
MAXIMUM  RANGE 

SONAR  TILT  ANGLE 

SONAR  RESPONSE 

DEG  DB 

-90.0 

18.0 

-16.0 

18.0 

-15.0 

14.6 

-14.0 

16.1 

-13.0 

17.4 

-12.0 

15.8 

-11.0 

13.2 

-10.0 

11.0 

- 9.0 

8.8 

- 8.0 

7.0 

- 7.0 

5.2 

- 6.0 

3.6 

0.00  55.0 
0.0  10000.0 
1.50  1.56 


39.5 


9840.0  FT 

3.0  MGS 
3.55  KCPS 

16.0  FT 

55.0  KYD 

5.0  DEG 


11.0 

5.0 

6.0 


KYD 

FT 

KM/S 
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Table  14  (Cont'd).  Input  Deck  for  Computing  Propagati 
Loss  versus  Range 


5.0 

2.3 

4.0 

1.0 

3.0 

0.5 

2.0 

0.2 

1.0 

0. 1 

0.0 

0.0 

2.0 

0.2 

3.0 

0.4 

5.0 

1.0 

7.0 

2.4 

8.0 

3.3 

9.0 

4.7 

10.0 

5.8 

11.0 

6.8 

12.0 

7.9 

13.0 

9.0 

14.0 

10.4 

15.0 

12.2 

16.0 

13.9 

17.0 

15.8 

18.0 

18.0 

90.0 

18.0 

A EOF 
PROCESS 

0.0  20.0  1.0 

A EOF 

RANGE  AXIS 

PROPAGATION  LOSS  AXIS 
MINIMUM  RANGE 
TARGET  DEPTH 
PROCESS 
A EOF 

TARGET  DEPTH 
PROCESS 
A EOF 
END 
A FIN 


DEG  2 

35.0  55.0  4.0 

40.0  140.0  5.0 

35.0  KYD 

25.0  FT 


150.0  FT 


4 


KYD 

DP 
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E.  RAYMODE  IV  and  RAYMODE  X - The  input  requirements  for  the  execution  of 
RAYMODE  IV  and  RAYMODE  X are: 

a.  one  card  read  by  format  12A6  followed  by 

b.  a NAMELIST  deck  called  INPUTS. 

a.  The  alphanumeric  card  is  used  to  title  the  case.  Any  comment  should  be 
centered  within  the  first  72  columns  for  best  results.  If  no  such  title  is  desired, 
insert  blank  card. 

b.  The  NAMELIST  data  deck  is  easy  to  work  with  when  running  more  than  one  case. 
For  a new  case,  the  user  needs  to  input  only  those  values  different  from  previously 
assigned  values.  Variables  may  be  read  in  any  order  and  need  not  be  in  special 
fields  or  on  separate  cards. 

The  minimum  input  information  to  be  supplied  by  the  user  consists  of: 

1)  sound  velocity  profile 

2)  depth  of  source  and  receiver 

3)  frequency 

4)  bottom  loss  table  (loss  vs.  grazing  angle)  or  MGS  province 
number 

5)  wind  speed 

6)  source  beam  specified  by  deviation  loss  table 

7)  receive  beam  specified  by  deviation  loss  table 

8)  range  limits  and  range  spacing  for  propagation  loss  computations 

9)  number  of  ray  cycles  required  for  bottom  bounce  propagation  loss 
computations 

10)  number  of  ray  cycles  required  for  non-bottom  bounce  propagation 
loss  computations  (e.g.,  surface  duct  or  convergence  zone) 

A discussion  of  the  particular  input  variables  are  listed  iji  table  15  on 
page  40.  Each  variable  is  typed  according  to  the  name  rule.  Arrays  are  dis- 
tinguished by  the  subscript  (I). 

Starred  entries  in  the  table  specify  a number  of  program  control  variables 
selectable  by  the  user  for  special  applications.  If  the  user  is  not  sufficiently 
familiar  with  the  program  to  assign  values  to  these  inputs,  he  may  rely  on  the 
default  values  automatically  assigned  by  the  program  during  execution,  which  are 
suitable  for  almost  all  cases.  A method  for  estimating  the  parameter  values  in 
9)  and  10)  above  are  given  at  the  end  of  this  discussion.  It  should  be  noted  that 
the  program  can  easily  be  made  to  assign  these  values  internally,  thus  relieving 
the  user  of  this  task.  (The  latter  approach  has  been  employed  in  the  adaptation 
of  RAYMODE  X to  the  Optimum  Mode  Selection  (OMS)  System  for  the  AN/BQQ-6  sonar.) 
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a-  ’min, 
b.  $ INPUTS 
N = 

Z(I)  = 

C(I)  = 

•SALNTY  = 

NU  = 

MU  = 

F = 

MGSOP  = 
ITAB  = 

THETA(I)  = 
BL(I)  = 

R = 

RMAX  = 
DELTAR  = 

WS  = 

IDL  = 


Table  15.  Definition  of  RAYMODE  X Input  Variables 

ALPHANUMERIC  HEADING  CARD 

(NAMELIST  name  in  columns  2-8). 

No.  of  points  in  sound  velocity  profile,  2<NS50. 

Depth  entries  from  surface  to  bottom  in  ft  or  yds. 

Velocity  entries  in  ft/sec  or  yd/sec  to  correspond  to 
depth  units  or  temperature  in  °F. 

A profile  may  be  made  up  of  a mixture  of  velocity  and 
temperature  entries.  The  depths  for  any  profile  in- 
volving BT  data  should  be  in  ft  and  any  included  veloc- 
ities in  ft/sec.  The  program  converts  each  profile  to 
yds  and  yds/sec.  It  is  better  to  input  all  new  Z and 
C arrays  than  to  modify  a profile  in  a previous  case. 

Salinity  in  0/00  for  conversion  of  temperatures  to 
sound  speed  (default  35). 

Index  of  source  depth,  2sNU<N. 

Index  of  receiver  depth,  2SMU<N.  Source  and  receiver 
depth  must  be  included  in  the  profile. 

Frequency  in  Hz. 

MGS  bottom  loss  province,  OSMGSOPS9  (default  0). 

No.  of  pts  in  input  bottom  loss  table,  OSITABsSO 
(default  0). 

Angles  in  deg.  for  bottom  loss  table  from  0°  to  ANGLE. 

Bottom  losses  indBSO.  Set  MGSOP  = 0 when  an  input 
bottom  loss  table  is  desired. 

0 

Range  minimum  in  yds,  R>0. 

Range  minimum  in  yds,  RMAXSR. 

Range  increment  in  yds,  DF,LTAR>0.  Maximum  no.  of 
ranges  = 400. 

Wind  speed  in  kts  (default  0). 

No.  of  pts  in  source  deviation  loss  table,  0SIDLSS0 
(default  0) . 


40 


Table  lS.(Cont'd).  Definition  of  RAYMODE  X Input  Variables 


THEDA (I)  = 
DL(I)  = 

JDL  = 

THEDA2(I)  = 
DL2  ( I ) = 

*ABL  = 

LAMDA  = 

LAMDAB  = 

* ANGLE  = 

*NL  = 

*M0  = 

*NKEXP  = 

$END 


Angles  in  deg,  for  source  deviation  loss  tables  to 
be  supplied  from  -ANGLE  to  ANGLE. 

Source  deviation  losses  indBaO  corresponding  to 
THEDA (1)  angles. 

No.  of  pts  in  receiver  deviation  loss  table,  0SJDL<50 
(default  0). 

Angles  in  deg.  for  receiver  deviation  loss  table  to 
be  supplied  from  -ANGLE  to  ANGLE. 

Receiver  deviation  losses  in  dB  > 0 corresponding  to 
THEDA2(1)  angles.  IDL  or  JDL  = 0 indicates  an  omni- 
directional source  or  receiver. 

Provides  variation  to  MGS  bottom  loss  curves  by 
adding  (B*ABL)  dB  to  MGS  curves.  0£ABL<2  (default  0). 

Maximum  no.  of  ray  cycles  for  propagation  modes  other 
than  bottom  bounce,  LAMDA  a 0. 

Maximum  no.  of  ray  cycles  for  bottom  bounce.  LAMDA  = 

0 indicates  direct  path  modes. 

Positive  and  negative  ray  angular  limits  in  deg, 

0°  ANGLE  90°  (default  60°). 

No.  of  pts  in  ray  tables,  2<NLS25  (default  10). 

Mode  cutoff  for  mode  summation  method,  3<M0<25 
(default  10). 

Interpolation  spacing  control  within  ray  tables, 

1 SNKEXPS4  default  2). 

(NAMELIST  deck  end  in  columns  2-5). 


‘Starred  inputs  are  defaulted  to  values  adequate  for  most  conditions.  I 
they  need  not  be  changed. 


< 


general , 
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A good  estimate  of  LAMDA  is 

LAMDA  = IFIX(RMAX/RC)+1 

where  RC  is  the  smallest  average  cycle  range  of  surface  duct  SD  (if  any)  or  conver- 
gence zone  CZ  ray  paths  (if  any).  That  is,  the  number  of  ray  cycles  should  be 
sufficiently  large  to  reach  the  maximum  range  selected. 

An  overly  large  LAMDA  will  give  accurate  results  but  will  cost  some  execution 
time  due  to  increased  testing;  the  program  does  not  waste  time  by  computing  ray 
effects  beyond  the  desired  RMAX.  Since  the  program  runs  in  considerably  less  than 
a minute  per  case  generally,  this  is  not  a real  problem.  A value  of  LAMDA  too 
small,  however,  will  result  in  poor  overall  propagation  loss,  since  not  enough  ray 
cycles  will  have  been  included. 

Similarly  LAMDAB  may  be  estimated  using  RC  associated  with  the  smallest  bottom 
bounce  angle.  This  will  be  roughly  the  same  as  the  RC  for  CZ  if  CZ  exists. 

Examples  of  RC: 

For  CZ  in  Atlantic  or  Pacific,  RC^70  kyd. 

For  CZ  in  Mediterranean,  RCV55  kyd. 

Average  SD  might  be  RC'vlO  kyd. 

The  plot  of  source  angle  versus  range  will  show  the  user  if  LAMDA  and  LAMDAB 
are  adequate,  since  these  plots  must  show  ray  path  contributions  out  to  the  maximum 
range  (RMAX) . 

These  two  inputs  have  been  maintained  in  order  to  give  the  user  versatility  in 
looking  at  various  paths.  As  mentioned  earlier,  for  general  propagation  loss  com- 
parisons the  calculations  of  LAMDA  and  LAMDAB  could  be  handled  by  the  program. 

An  example  of  a RAYMODE  X deck  for  a run  producing  transmission  loss  versus 
range  outputs  for  three  cases  (source  depth  = 500  ft,  receiver  depth  = 300  ft, 
frequency  = 400,  500,  2000  Hz)  is  given  in  table  16. 
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Table  16.  Sample  Multicase  Run  Stream  Table 


PDATA, L JP*DATA 

DATA  T7  RL70-5  08/12-07:45:22 

1.  PARKA  DATA 

2.  $ INPUTS 

3.  N=29 , 

4.  Z(1)=0., 50. ,100. ,131. 2,164. ,180. 5, 200. ,229. 1,246.1,  262.5, 

5.  278.9,360. ,400. ,500. ,600. ,800. , 1200. , 1312.3,1968.5,2500.  , 

6.  3280.8,4921.2,6561.7,8202. 1,9842.5,11482.9,13123.3,16404.2, 

7.  18044.6, 

8.  C(l)=5022. 17,5022.99,5023.81,5024.33,5024.87,5025.14,  5025.46, 

9.  5025.95,5026.22,5026.5,5024.32,5018.87,4995.16,4983.05,4911.65, 

10.  4953.37,4922.25,4913.93,4876.22,4861.85,4857.19,4876.77,4894.18, 

11 . 4918.49,4947.27,4913.6,5002.04,5000.12,5089.61, 

12.  NU=14,  MU=12,  F=50. , MGSOP=2, 

13.  R=1000. , RMAX=260000. , DELTAR=1060. , WS=10. , 

14.  NL=25,  M0=10,  LAMDA=  5 , LAMl)AB=5,  PLOTOP=0,  PLOTT=0,  PLOTCZ=0, 

15.  SEND 

16.  PARKA  DATA 

17.  SINPUTS 

18.  F=400 . , 

19.  SEND 

20.  PARKA  DATA 

21.  SINPUTS 

22.  F=500. , 

23.  SEND 

24 . PARKA  DATA 

25.  SINPUTS 

26.  F=2000. , 

27.  SEND 
END  DATA. 

@XQT  TEN*RAYMOD. RAMODXA 
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ANC I L LA  RY  I N FORMAT  I ON 


All  model  programs  provide  information  other  than  propagation  loss  as  a function 
of  range.  Such  information  could  be  useful  to  a potential  customer  and  is  given 
below: 

A.  FFP  --  Provides  the  beamformer  output,  as  a function  of  angle,  for  a 
horizontal  or  vertical  linear  array. 

B.  CONGRATS  V --  This  program  is  still  in  the  process  of  development.  It  is 
intended  to  be  a generic  program  of  very  general  application.  Included  in  the 
available  output  will  be 

a)  complete  ray  tracing 

bj  reverberation  as  a function  of  time  for  a given  source-receiver 
conf igurat ion 

c)  Eigenray  solutions 

d)  Sorting  of  the  eigenrays  by  angle 

e)  Six  curve  fits  for  sound-speed  profiles 

It  is  anticipated  that  additional  features  will  be 

implemented . 

C.  FACT  --  Gives  angle  of  arrival  for  rays  arriving  at  angles  within  ^25°. 

D.  NISSM  II  --  Plots  Available 


Velocity  versus  Depth 
Ray  Diagram 

Propagation  Loss  versus  Range  for  Specific  Target  Depth 
Reverberation  versus  Time 
Surface  Reverberation 
Bottom  Reverberation 
Volume  Reverberation 
Total  Reverberation 
Signal  Excess  versus  Range 
Probability  of  Detection  versus  Range 


Printed  Output  Available  --  Tables 


Ray  printout  at  points  along  the  ray: 

Range,  Depth,  Angle  (deg).  Arc  Length, 

Travel  Time,  Propagation  Loss  (dB) 

Eigenray  printout: 

Range,  Sonar  Angle,  Target  Angle,  Arc  Length, 
Travel  Time  (sec),  Propagation  Loss  (dB) , 
Phase  (deg) 


Propagation  Lo 


Reverberat ion 


ss  versus  Range 
versus  Time 


Random  Phase  Addition 
Coherent  Phase  Addition 

Surface,  Bottom,  Volume 
Total 


Signal  Excess  versus  Range 
Probability  of  Detection  versus  Range. 
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E.  Raymode  IV  --  Raymode  X has  replaced  this  model  in  actual  use. 

F.  Raymode  X --  Information  obtainable  from  Raymode  X in  addition  to  propa- 
gation loss  versus  range  includes: 

a.  A 2-page  input  plot  which  includes  plots  of  the  entire  profile  and  an 
enlarged  near-surface  profile  plus  curves  of  bottom  loss  vs.  grazing  angle, 
surface  loss  vs.  grazing  angle,  and  beam  deviation  loss  vs.  angle  relative 
to  beam  MRA  (Maximum  Response  Axis)  if  they  are  being  used. 

b.  Plots  of  course  angle  vs.  range  and  receiver  angle  vs.  range  for  each 
separate  propagation  path. 

c.  A plot  of  travel  time  vs.  range  for  each  separate  propagation  path. 

d.  Travel  time  differences  between  multipaths  given  with  respect  to  an 
assigned  path  time  reference. 
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SUMMARY  AND  CONCLUSIONS 


One  of  the  difficult  choices  facing  the  sonar  systems  engineer  or  underwater 
acoustician  is  which  among  many  possible  models  to  use  for  a given  application. 

Many  factors  enter  into  such  a decision:  (1)  Accuracy,  (2)  Running  Time,  (3)  Com- 

puter Storage  Required,  (4)  Ease  of  Implementation,  (5)  Complexity  of  Program  Exe- 
cution, (6)  Ease  of  Effecting  Slight  Alterations  to  the  Program,  and  (7)  Available 
Ancillary  Information.  If  information  relating  to  these  factors  were  readily  avail- 
able the  selection  of  a model  could  be  performed  with  a minimum  of  effort  and  a 
maximum  of  confidence.  An  attempt  has  been  made  in  this  report  to  supply  such 
information  for  a specific  type  of  model  (transmission  loss)  for  the  purpose  of 
determining  the  difficulty  in  amassing  such  knowledge  and  to  determine  if  the  re- 
sultant of  such  an  effort  does  indeed  optimize  the  model  selection  process.  Accord- 
ingly, transmission  loss  models  available  at  the  Naval  Underwater  Systems  Center 
were  examined  in  terms  of  the  aforementioned  factors.  The  models  were  CONGRATS  V, 
FACT,  NISSM  II,  RAYMOUE  IV  and  RAYMODE  X and  they  were  run  using  both  coherent  and 
incoherent  phase  addition.  Eight  cases  were  examined;  in  the  first  six  the  Fast 
Field  Program  (FFP)  was  the  standard  of  comparison  and  (1/3-octave)  PARKA  data  was 
the  standard  for  the  remaining  two  cases.  In  all  cases  a single  sound  speed  profile 
appropriate  to  the  PARKA  data  was  used  in  producing  model  outputs.  The  first  six 
cases  are  for  frequencies  of  50,  500  and  2000  Hz  with  source  and  receiver  (1)  both 
in  a surface  duct  and  (2)  both  below  the  surface  layer.  The  last  two  cases  have 
both  source  and  receiver  below  the  layer  and  the  frequencies  are  50  and  400  Hz. 

(In  the  last  two  cases  the  FFP  was  included  among  the  models  in  two  forms;  first, 
under  the  normal  assumption  of  an  infinitely  long  CW  source  and,  secondly,  assuming 
a 1/3-octave  source  with  a flat  spectrum  over  the  band.) 

In  the  assessment  of  accuracy,  coherent  models  were  compared  quantitatively  in 
terms  of  their  range  dependent  mean  levels  (as  obtained  through  polynomial  fits). 
Incoherent  models  yield  outputs  essentially  lacking  in  rapid  fluctuations  and  hence 
were  compared  to  the  standard  without  further  smoothing  (as  was  also  the  case  for 
the  1/3-octave  FFP  output).  The  approach  used  provides  the  information  required  to 
determine  the  accuracies  of  two  or  more  models  from  a small  number  of  quantitative 
measures  and  also  provides  intermediate  products  useful  in  the  analysis  of  dis- 
crepancies between  a given  model  and  the  standard.  For  the  cases  listed  above,  two 
models  achieved  essentially  equal  overall  accuracy  and,  therefore,  share  a first 
place  standing  in  accuracy  - CONGRATS  V and  RAYMODE  X.  This  should  not  be  inter- 
preted as  meaning  that  other  models  are  not  sufficiently  accurate  for  specific 
applications  - this  issue  is  to  be  decided  by  the  user. 

Computer  run  times  were  normalized  to  account  for  differences  in  numbers  of 
points  generated  by  each  model.  The  models  exhibiting  the  shortest  run  times  were 
FACT  and  RAYMODE  X.  It  must  be  recognized  that  programs  have  been  optimized  for 
short  running  times  to  varying  degrees.  The  results  obtained  do  not  imply  that 
slower  programs  cannot  be  so  optimized.  These  same  general  comments  can  also  be 
made  in  regard  to  computer  storage  requirements.  In  the  cases  examined  above,  the 
models  which  required  the  least  storage  (excluding  storage  required  for  plot  rou- 
tines) were  RAYMODE  IV  and  RAYMODE  X. 

Ease  of  implementation  of  a given  program  on  a specific  computer  is  a factor 
not  directly  addressed  in  this  report.  Although  the  number  of  different  computers 
on  which  a program  has  successfully  been  run  is  an  indicator,  it  can  be  misleading 
for  those  programs  which  have  been  recently  developed  or  are  still  in  the  development 
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stage.  Another  indirect  manner  in  which  ease  of  implementation  may  be  assessed  is 
through  available  documentation.  Accordingly  a list  of  references  has  been  provided 
(see  p.  49).  Of  perhaps  primary  assistance  to  a user  in  determining  ease  of  imple- 
mentation is  access  to  the  author(s)  of  a given  program  (or  people  completely  ac- 
quainted with  the  program).  To  this  end,  a list  of  such  personnel  has  been  included 
(see  p.  30) . 

The  complexity  of  program  execution  is  well  revealed  by  providing  the  input 
card  deck  required  to  run  the  program  with  appropriate  definitions,  default  values 
and  explanations  of  the  meaning  of  various  parameters  and  guidance  relating  to 
their  selection.  Such  information  has  been  provided  in  the  body  of  this  report  to 
a limited  extent.  In  this  context,  "user’s  guides"  can  be  most  valuable  and  the 
reader  is  referred  to  the  list  of  references.  The  desirability  of  a given  input 
deck  depends  upon  its  requirements  vis-a-vis  the  requirements  for  a given  applica- 
tion. The  degree  of  concordance  between  desired  and  actual  complexity  of  program 
execution  must  be  assessed  by  the  user. 

It  is  quite  possible  that  a program  is  "almost  right"  for  a given  application 
and  that  slight  alterations  are  required.  Even  given  a program  listing,  effecting 
a slight  alteration  may  be  complex  and  involve  several  subroutines.  For  this  reason, 
consultation  with  the  author  of  a program  (or  a person  fully  cognizant  of  all  pro- 
gramming details)  is  recommended.  Once  again  the  reader  is  directed  to  the  list 
on  page  30. 

Ancillary  information  may  be  desirable  or  not  depending  on  the  application. 

Some  models  provide  only  transmission  loss  versus  range.  Others  are  components  of 
a complete  systems  model  and,  thus,  can  provide  a variety  of  information  such  as 
reverberation  level  vs.  time,  probability  of  detection  vs.  range,  etc.  A list  of 
available  ancillary  information  for  each  model  is  to  be  found  on  pages  44-45. 

In  attempting  to  provide  information  relating  to  the  factors  needed  for  an  in- 
telligent choice  of  a model  for  a given  application  various  conclusions  can  be 
drawn:  (1)  The  quantitative  method  of  accuracy  assessment  utilized  leads  to  re- 

sults easily  interpreted  by  a user  in  terms  of  an  accuracy  requirement.  Although 
the  use  of  several  polynomials  requires  somewhat  subjective  decisions  with  regard  to 
identifying  significant  features  in  a data  record  and  breaking  up  this  record 
accordingly,  an  examination  of  the  results  reveals  this  problem  to  be  of  minor 
significance  (i.e.,  different  choices  would  have  negligible  effects  on  final 
results).  Nonetheless,  future  smoothing  of  records  with  rapid  fluctuations  will  be 
done  using  moving  averages,  thereby  obtaining  greater  objectivity.  (2)  The  choice 
of  weighting  factors  to  be  utilized  in  the  quantitative  assessment  of  model  accuracy 
is  best  determined  by  the  user  based  upon  system  parameters,  environmental  scenarios 
and  tactical  constraints.  (3)  The  standard(s)  of  comparison  must  be  of  significance 
to  the  user.  (4)  A sufficient  number  of  environmental  situations  must  be  treated 
for  the  final  results  to  lead  to  a valid  choice  of  a "best"  model  for  a specific 
appl icat ion . 

The  matrix  of  information  provided  for  the  various  candidate  models  should  lead 
to  model  selection  for  various  applications  in  a more  optimal  fashion  than  has  been 
heretofore  possible.  The  matrix  presented  and  applied  to  transmission  loss  models 
in  this  report  is  general  in  its  nature  and  the  same  techniques  can  be  applied  to 
any  type  of  model. 
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It  should  be  stressed  that  the  methodology  described  in  this  report  is  still 
in  a state  of  evolution.  Some  changes  to  be  introduced  in  furture  analyses  - - 
the  use  of  sliding  averages  instead  of  polynomials  for  smoothing  and  the  determi- 
nation of  range  intervals  on  the  basis  of  physical  features  of  the  acoustic  path  - 
have  already  been  mentioned.  Other  possible  changes,  such  as  the  use  of  higher 
statistical  moments,  will  also  be  considered. 
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APPENDIX  A 


AVERAGING:  DECIBELS  VERSUS  PRESSURE 

In  all  the  analyses  described  in  this  report  smoothing  of  propagation  loss  data 
was  accomplished  by  operating  on  values  expressed  in  decibels.  Smoothing  of  data 
expressed  in  terms  of  physical  parameters  such  as  acoustic  intensity  (pressure 
squared)  and  acoustic  pressure  was  undertaken  for  comparison  purposes.  Two  smooth- 
ing functions  were  used:  polynomials  and  sliding  averages.  In  each  case  the  deci- 

bel (dB)  values  were  converted  to  the  "physical"  parameters;  these  were  then  smooth- 
ed and  the  resultant  values  reconverted  to  decibels.  Case  4 (source  depth  = 500  ft., 
receiver  depth  = 300  ft.,  frequency  = 50  Hz)  data  were  chosen  for  these  calculations. 
The  results  are  described  in  what  follows. 

POLYNOMIALS 

The  Case  4 FFP  propagation  loss  values,  PL,  expressed  in  decibels  were  con- 
verted to  the  parameter  A*,  proportional  to  acoustic  pressure,  by  means  of 

A = antilog  (PL/20). 

The  set  A was  then  subdivided  into  the  same  five  groups  as  the  original  data,  and 
a best  fit  polynomial  for  each  group  was  found.  The  values  obtained  from  the  poly- 
nomials were  then  reconverted  to  decibels  by  means  of  the  inverse  of  the  relation 
given  above.  However,  some  of  the  values  of  A determined  by  the  polynomials  were 
negative.  Specifically,  the  first  ten  values  (corresponding  to  the  ten  smallest 
values  of  range)  and  eight  values  at  ranges  in  the  vicinity  of  70  kyd  were  negative. 
An  attempt  to  use  acoustic  intensity  (or  pressure  squared)  as  the  parameter  in  this 
comparison  failed  for  the  same  reason.  Since  pressure  squared  cannot  be  negative, 
the  parameter  A,  proportional  to  pressure,  was  used  instead.  Since  a logarithm  of 
a negative  number  is  not  real,  it  was  decided  to  ignore  these  18  negative  numbers 
in  all  further  data  processing.  The  remaining  dB  values  are  shown  plotted  in  figure 
A3.  Figures  A1  and  A2  show,  respectively,  the  original  FFP  data  and  the  polynomial 
approximations  obtained  from  the  original  dB  values. 

A comparison  of  the  pertinent  figures  will  show  that  the  polynon.:als  fit  to  the 
data  expressed  in  decibels  give  a much  better  approximation  to  the  original  data  than 
the  "A  polynomials".  Thus  the  "A  polynomials"  show  marked  distortion  in  the  bottom 
bounce  region  (ranges  between  35  and  65  kyd) and  in  both  sections  of  the  convergence 
zone  (ranges  between  60  and  75  kyd).  The  "dB  polynomials",  on  the  other  hand,  show 
good  agreement  with  the  original  data  throughout  the  whole  curve.  This  is  to  be 
expected.  For,  whatever  physical  reason  one  may  have  for  converting  the  data  to 
other  units  prior  to  processing,  mathematically  one  would  expect  better  agreement 
with  the  original  data  when  the  approximating  function  uses  the  original  data  rather 
than  "converted"  data. 

SLIDING  AVERAGES 

The  sliding  averages  were  formed  as  follows:  the  arithmetic  mean  of  propaga- 

tion loss  values  1 to  n was  found.  The  process  was  repeated  for  points  2 to  n+1, 

♦From  PL  = 20  log(P/PQ) ,one  gets  A = P/Pq  = antilog  (PL/20).  Thus  A is  the  ratio  of 

the  acoustic  pressure  at  the  receiver  to  the  index  pressure. 
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then  for  3 to  n+2,  etc.,  until  all  available  sets  of  n points  had  been  used.  The 
range  corresponding  to  the  first  set  of  n points  was  the  largest  listed  range  that 
was  equal  to  or  less  than  the  mean  of  the  first  n ranges.  Successive  listed  ranges 
were  then  associated  with  averages  of  successive  groups  of  points.  Models  used  were 
FFP  and  coherent  values  of  NISSM  II  for  Case  4.  The  averaging  process  was  applied 
to  the  dB  values  of  propagation  loss,  PL,  and  to  a parameter  B,  proportional  to 
acoustic  pressure  squared,  where 

B = antilog  (PL/10) . 

The  averaged  values  of  B were  then  reconverted  to  decibels.  The  parameter  n (the 
number  of  points  in  each  set)  was  assigned  values  so  that  averaging  would  take  place 
successively  over  range  intervals  of  2,  4 and  8 kyd  for  the  NISSM  II  model.  For  the 
FFP,  choices  of  n of  30,  50,  100,  and  200  points  correspond  to  averaging  over 
ranges  of  2.35,  3.92,  7.84,  and  15.69  kyd.  The  sets  of  averaged  points  were  plotted 
as  a function  of  the  respective  ranges. 

The  results  obtained  with  the  FFP  and  NISSM  II  models  are  shown  in  figures  A4- 
All  and  A12-A18,  respectively.  Figure  A4  shows  the  result  of  "pressure-squared" 
averaging  of  the  FFP  with  the  number  of  points  involved  in  the  average  equal  to  30; 
figure  A5  shows  the  corresponding  result  for  "decibel  averaging".  The  figure  sets 
(A6,A7),  (A8.A9),  and  (A10,A11)  present  similar  results  for  n equal  to  50,  100,  and 
200  points,  respectively.  Figure  A12  shows  the  original  NISSM  II  coherent  results 
for  case  4.  Figures  A13-A18  show  the  results  of  averaging  these  data  over  the  range 
intervals  of  2,  4,  and  8 kyd.  Once  again,  both  "decibel  averaging"  and  "pressure- 
squared  averaging"  were  performed. 

Reference  to  the  figures  will  show  that  both  types  of  averaging  have  the 
predictable  effect  of  eliminating  much  of  the  "fine  structure"  of  the  original  data, 
and  also  of  "compressing"  the  data  - that  is,  both  high  and  low  spikes  are  clipped. 
However,  "pressure  square  averaging"  also  has  the  effect  of  broadening  the  (reduced) 
spikes.  The  broadening  is  proportional  to  n,  the  range  interval  used  in  the  aver- 
aging. This  is  explained  by  the  fact  that  a difference  of  several  dB  between 
neighboring  points  is  magnified  manyfold  when  the  values  are  expressed  as  pressure 
squares.  Thus  in  the  latter  unit  the  spike  will  dominate  the  n groups  of  values  in 
which  it  appears,  thus  broadening  the  spike.  This  broadening  effect  on  the  indivi- 
dual spikes  in  turn  causes  a narrowing  of  both  the  bottom  bounce  zone  (30  to  55  kyd 
range)  and  the  convergence  zone  (60  to  75  kyd)  by  prolonging  the  effect  of  the 
spikes  into  these  regions.  This  broadening  is  largely  absent  in  "dB  averaging".  If 
n is  so  chosen  that  averaging  is  over  a large  range  interval,  then  the  features  of 
the  original  curve  are  completely  lost  in  "pressure  averaging"  --  as  in  figures  A10 
and  All,  in  which  the  range  interval  is  almost  16  kyd. 

Here  too,  processing  the  original  data  yields  better  results  than  conversion  of 
data  prior  to  processing.  "dB  averaging"  retains  the  major  features  of  the  original 
curve,  while  "pressure  square  averaging"  distorts  these  features,  and,  if  the 
averaging  interval  is  large  enough,  these  features  are  completely  lost. 
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In  all  comparisons  conducted  between  1)  smoothing  by  means  of  the  original  data 
in  dB  and  2)  converting  the  data  to  pressure  or  pressure  squared,  smoothing  and 
reconverting  to  dB,  the  former  process  gave  better  results.  It  is  therefore  con- 
cluded that,  mathematically  at  least,  smoothing  should  be  done  on  the  original  data 
without  conversion.  That  this  is  also  preferable  from  a physical  point  of  view  will 
now  be  discussed. 

When  statistical  analyses  are  performed  on  data  expressed  in  decibels,  the  objec- 
tion is  sometimes  raised  that  this  procedure  is  invalid.  Instead,  as  this  view 
would  have  it,  one  must  first  convert  the  data  into  units  such  as  pressure  or 
intensity  before  applying  the  statistics.  In  the  view  of  the  authors,  the  units  to 
be  used  in  our  analysis  will  depend  on  the  objective  of  the  analysis.  Thus  if  one 
is  interested  in  the  average  acoustic  intensity  obtained  from  several  measurements, 
averaging  of  decibel  units  is  incorrect.  However,  if  one  is  dealing  with  the 
response  of  a human  operator  to  acoustic  waves,  use  of  decibel  units  is  correct. 

The  reason  for  this  is  to  be  found  in  Ware  and  Reed*:  "The  Weber-Fechner  law  of 
phychology  states  that  'the  minimum  change  in  stimulus  necessary  to  produce  a 
perceptible  change  in  response  is  proportional  to  the  stimulus  already  existing.  . . 
This  leads  to  the  logical  use  of  some  unit  in  attenuation  which  is  proportional  to 
the  logarithm  of  the  change  ratio."  Thus  what  appear,  for  example,  to  the  ear  to 
be  equal  increments  in  loudness  are  actually  equal  ratios  of  intensities  or  equal 
differences  in  (decibel)  levels.  Hence,  in  such  studies  as  the  statistics  of 
acoustic  recognition  differential,  it  would  be  essential  to  use  decibel  units. 

Since  the  ultimate  application  of  these  studies  will  be  to  sonar  system  design,  the 
use  of  decibel  units  is  indicated/! 

The  arguments  given  above  for  using  decibel  units  in  our  statistical  analyses 
centered  about  data  smoothing  (or  "averaging")  - - the  first  step  in  the  process 
called  "assessment  of  accuracy"  (See  p.  14).  Steps  (2),  (3)  and  (4)  make  use  of 
the  results  obtained  in  this  first  step.  Step  (2)  calls  for  finding  the  difference 
between  the  standard  and  smoothed  model;  step  (3)  calls  for  grouping  these  dif- 
ferences; and  step  (4)  calls  for  finding  u and  a for  each  group.  Since  it  was 
shown  that  the  use  of  decibel  units  in  step  (1)  is  called  for,  it  follows  that 
decibel  units  should  also  be  used  in  the  other  steps. 


* Lawrence,  A.,  Ware  and  Henry  R.  Reed,  "Communication  Circuits,"  John  Wiley  5 
Sons,  Inc.,  1944,  Second  Edition,  pp.  46-47. 

t It  should  also  be  kept  in  mind  that  propagation  loss  values  are  expressed  in  dB 
because  this  is  the  way  they  are  used  in  the  sonar  equations  to  make  performance 
predictions.  Therefore,  the  only  reasonable  way  to  obtain  an  average  value  which 
is  representative  of  the  individuals  in  the  group  is  to  compute  the  average  in  dB 
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Of  the  two  types  of  smoothing  used  so  far  in  these  studies,  sliding  averages, 
for  an  appropriate  value  of  N,  yield  a closer  approximation  to  the  original  data 
than  do  polynomials.  In  the  former,  while  rapid  fluctuations  are  smoothed  out, 
slower  fluctuations  are  retained.  This  tends  to  retain  many  details  of  the  original 
data, including  some  unwanted  ones.  Polynomials  as  used  in  these  studies,  on  the 
other  hand,  have  smoothed  out  all  but  major  features  of  the  original  data.  One 
reason  for  this  is  that  when  the  data  were  subdivided  into  groups  for  polynomial 
approximation,  each  group  usually  included  many  more  points  than  were  included  in 
the  groups  used  in  sliding  averages.  Increasing  the  size  of  the  group  in  the 
latter  process  tends  to  distort  the  original  curve  unduly.  Mathematically, 
polynomials  can  be  stored  as  a set  of  coefficients,  something  which  cannot  be  done 
with  sliding  averages.  On  the  other  hand,  the  polynomial  method  requires  the 
making  of  choices  in  the  process  of  subdividing  the  data  into  sets,  whereas  this  is 
avoided  if  sliding  averages  are  used.  After  considering  all  the  factors  discussed 
above,  it  was  decided  to  use  sliding  averages  for  data  smoothing  in  future  analyses. 


* Processing  in  decibel  units  is  assumed  in  this  section. 
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APPliNDI  X B 


Appendix  B contains  all  figures  pertaining  to  the  quantitative  assessment  of 
accuracy.  F.ach  figure  is  designated  by  a roman  numeral,  an  arabic  numeral  and  a 
letter  (e.g.,  V-3C).  The  roman  numeral  gives  the  case  (i.e.,  roman  numeral  V 
corresponds  to  Case  5).  Arabic  numerals  denote  the  various  models,  as  follows: 

1 - FFP 

2 - CONGRATS  V 

3 - FACT 

4 - NISSM  II 

5 - RAYMODE  IV 

6 - RAYMODE  X 


For  roman  numerals  I-VI  and  arabic  numeral  1,  the  letter  A gives  the  raw  model 
output  while  B gives  the  analytical  fit.  For  roman  numerals  I-VI  and  arabic  numerals 
2-6,  the  letters  designate  the  following: 

A - Raw  Model  Output  (Coherent  Phase  Addition) 

B - Analytical  Fit  to  (A) 

C - FFP  Analytical  Fit  Minus  (B) 

D - Raw  Model  Output  (Incoherent  Phase  Addition) 

E - FFP  Analytical  Fit  Minus  (D) 


For  roman  numerals  VII  and  VIII  and  for  all  arabic  numerals  with  the  exception 
of  1,  the  letters  designate  the  following: 


A - PARKA  Experimental  Data  and  Raw  Model  Output 
(Coherent  Phase  Addition) 

B - PARKA  Experimental  Data  and  the  Analytical  Fit  to  the  Model 

C - PARKA  Experimental  Data  Minus  the  Analytical  Fit  to  the  Model 

D - PARKA  Experimental  Data  and  Raw  Model  Output 
(Incoherent  Phase  Addition) 

E - PARKA  Experimental  Data  Minus  the  Incoherent  Model  Output 


For  1 (i.e.,  the  FFP)  these  letter  designations  hold  upon  replacement  of  the  phrases 
"Coherent  Phase  Addition"  and  "Incoherent  Phase  Addition"  by  "CW"  and  "1 /3-Octave" , 
respectively. 
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■ 

■ 

1.7 

-5.2 

0.2 

■ 

1.0 

NISSM  II 
COHERENT* 

-14.8 

0.5 

-12.7 

0.6 

-15.0 

5.0 

-15.1 

2.0 

-14.1 

3.1 

■ 

3.0 

-15.0 

0.7 

-14.2 

■ 

-15.5 

1.2 

-14.2 

2.6 

RAYMODE  IV 
COHERENT* 

-1.7 

1.5 

-6.6 

0.7 

3.1 

-9.6 

■ 

-29.6 

6.0 

-11.4 

10.6 

RAYMODE  IV 
INCOHERENT 

-0.9 

1.3 

-4.0 

1.0 

-8.3 

1.4 

-9.2 

B 

-23.7 

1 

-9.2 

8.3 

RAY MODE  X 
COHERENT* 

1.0 

2.3 

0.3 

2.1 

0.3 

2.3 

1.0 

2.1 

0.3 

2.2 

0.7 

RAYMODE  X 
INCOHERENT 

-0.7 

1.9 

-0.8 

1.2 

-0.9 

1.2 

-0.5 

1.4 

1.4 
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Table  C-4 


MEANS  AND  STANDARD  DEVIATIONS  OF 
DIFFERENCES  BETWEEN  THE  FFP*  AND 
PROPAGATION  LOSS  MODELS:  CASE  4 


RANGE 

INTERVAL 

(KILOYARDS) 

0- 

— 

20 

20- 

— 

40 

40- 

60 

O' 

0 

1 

80 

80- 

100 

0- 

100 

n 

o 

a 

0 

u 

0 

m 

n 

m 

0 

u 

n 

CONGRATS  V 
COHERENT  * 

1.9 

1.5 

0.7 

l1:8- 

2.9 

4.0 

0.0 

1.8 

1.3 

B 

CONGRATS  V 
INCOHERENT 

B 

2.3 

4.0 

8 

5.6 

1 

0.4 

5.1 

0.7 

2.8 



3.0 

5.1 

FACT 

COHERENT* 

1.8 

2.  1 

0. 1 

3.8 

6.0 

3.0 

0.1 

4.0 

5.0 

B 

FACT 

INCOHERENT 

2.2 

B 

B 

6.2 

6.2 

0.5 

4.8 

1.4 

3.5 

NISSM  II 
COHERENT* 

0.1 

0.7 

-0.3 

1.5 

-1.9 

3.9 

-6.5 

8.7 

-0.1 

2.2 

NISSM  II 
INCOHERENT 

3.0 

1.8 

3 . 6 

5.1 

7.0 

-3.5 

B 

-1.0 

B 

1.4 

5.6 

RAYMODE  IV 
COHERENT* 

fl 

3.2 

n 

I 

-0.3 

7.8 

1.2 

9.2 

2.6 

-0.7 

6 . 5 

RAYMODE  IV 
INCOHERENT 

4.0 

1.9 

i.i 

B 

3.1 

8.8 

2.8 

1.3 

1.7 

B 

RAYMODE  X 
COHERENT* 

2.3 

2., 

1.0 

1.5 

-1.1 

1.8 

-2.8 

5.1 

-1.7 

2.5 

-0.5 

B 

RAYMODE  X 
INCOHERENT 

4.0 

a 

B 

B 

5.6 

a 

-0.  1 

5.3 

-1.5 

2.9 

H 

5.6 
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Table  C-5 

MEANS  AND  STANDARD  DEVIATIONS  OF 
DIFFERENCES  BETWEEN  THE  FFP*  AND 
PROPAGATION  LOSS  MODELS:  CASE  5 


RANGE 

INTERVAL 

(KILOYARDS) 

0- 

20 

20- 

40 

40- 

60 

60- 

80 

80- 

100 

0- 

100 

■■1 

||  | 

0 

y 

0 

y 

n 

n 

n 

m 

0 

D 

0 

CONGRATS  V 
COHERENT  * 

0.5 

2.5 

1.9 

0.1 

3.1 

-0.3 

6.7 

0.3 

B 

0.0 

CONGRATS  V 
INCOHERENT 

1.4 

1.2 

1.2 

0.6 

1.0 

1.0 

0.9 

5.5 

n 

3.5 

FACT 

COHERENT* 

-2.  1 

1.9 

-4.0 

5.0 

-0.6 

5.6 

1.6 

5.2 

0.3 

-1.0 

5.2 

FACT 

INCOHERENT 

1.1 

1.5 

1.8 

0.6 

1.9 

1.7 

1.8 

6.0 

5.0 

4.8 

2.3 

3.8 

NISSM  II 
COHERENT* 

-1.0 

1.2 

-0.3 

2.5 

. .. 

0. 1 

2.6 

-5.6 

9.0 

-0.7 

B 

-1.5 

5.3 

NISSM  II 
INCOHERENT 

0.4 

1.4 

1.2 

0.7 

0.9 

1.0 

B 

n 

1.8 

3.8 

0.4 

4.1 

RAYMODE  IV 
COHERENT* 

-0.3 

3.8 

-2.8 

0.9 

-3.1 

2.8 

0.6 

8.1 

5.6 

-2.6 

5.6 

RAYMODE  IV 
INCOHERENT 

1.4 

1.1 

-2.2 

1.1 

a 

3.3 

B 

6.0 

-0.6 

4.8 

RAYMODE  X 
COHERENT* 

-0.6 

0.9 

-0.4 

0.8 

-0.2 

0.9 

-1.7 

3.9 

-1.3 

3.3 

-0.8 

n 

RAYMODE  X 
INCOHERENT 

0.7 

— 

1.1 

1.4 

0.6 

0.9 

1.1 

1.0 

n 

0.8 

■ 

2.9 
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Table  C-6 


MEANS  AND  STANDARD  DEVIATIONS  OF 
DIFFERENCES  BETWEEN  THE  FFP*  AND 
PROPAGATION  LOSS  MODELS:  CASE  6 


RANGE 

INTERVAL 

(KILOYARDS) 

0-20 

20-40 

40-60 

60-80 

80-100 

0-100 

y 

0 

«■ 

m 

m 

0 

■ 

— 

0 

m 

0 

m 

a 

CONGRATS  V 
COHERENT  * 

0.0 

2.5 

-0.5 

1.3 

0.4 

1.6 

g 

6.3 

i . i 

1.7 

g 

m 

CONGRATS  V 
INCOHERENT 

1.6 

1.2 

1.6 

1.2 

a 

1.6 

0.3 

■ 

1 .8 

2.5 

FACT 

COHERENT* 

0.4 

1.5 

-2.0 

2.3 

0.7 

0.2 

2.1 

4.8 

0.3 

3.6 

FACT 

INCOHERENT 

1.5 

n 

2.3 

1.6 

3.9 

3.5 

2.6 

3.2 

NISSM  II 
COHERENT* 

0.4 

n 

-3.3 

2.6 

0. 1 



3.3 

B 

g 

5.0 

NISSM  II 
INCOHERENT 

0.4 

1.6 

1.4 

1.0 

Q 

1.5 

6.1 

2.3 

B 

3.8 

RAYMODE  IV 
COHERENT* 

0.2 

1.1 

-5.0 

Q 

B 

1.5 

Mj 

g 

8.3 

6.5 

RAYMODE  IV 
INCOHERENT 

1.2 

1.9 

-1.2 

1.2 

-1.3 

3.5 

1.9 

4.0 

g 

5.5 

g 

g 

RAYMODE  X 
COHERENT* 

0.  1 

0.8 

0.3 

1.2 

0.6 

2.2 

g 

B 

3.3 

g 

RAYMODE  X 
INCOHERENT 

1.2 

1.1 

1.9 

1.0 

1.7 

0.3 

3.8 

1.5 

1.5 

1.4 

2.2 
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MEANS  AND  STANDARD  DEVIATIONS  OF  DIFFERENCES  BETWEEN  PARKA  DATA  AND  MODEL  RESULTS:  CASE 


Table  C-7 
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MEANS  AND  STANDARD  DEVIATIONS  OF  DIFFERENCES  BETWEEN  PARKA  DATA  AND  MODEL  RESULTS:  CASE  8 


Table  C-8 
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Table  C-9 


MEANS  AND  STANDARD  DEVIATIONS  OF 
DIFFERENCES  BETWEEN  THE  FFP*  AND 
PROPAGATION  LOSS  MODELS:  CASES  1-3 


RANGE 

INTERVAL 

(KILOYARDS) 

0-20 

20-40 

40-60 

60-80 

80-100 

0-100 

m 

a 

n 

0 

m 

0 

■ 

— 

a 

a 

a 

D 

n 

CONGRATS  V 
COHERENT  * 

n 

-0.4 

0.8 

-0.1 

1.1 

-0.6 

8 

-2.9 

5.8 

g 

B 

CONGRATS  V 
INCOHERENT 

2.1 

a 

-1.1 

3.0 

1.8 

4.0 

2.6 

6.8 

0.7 

3.5 

1.2 

5.5 

FACT 

COHERENT* 

0.2 

3.6 

-1.6 

1.7 

-1.8 

2.1 

6.8 

-4.8 

i 

B 

B 

FACT 

INCOHERENT 

0. 1 

B 

1.9 

-0.1 

■ 

B 

5.6 

B 

NISSM  II 
COHERENT* 

a 

D 

B 

6.2 

-6.8 

5.1 

-7.7 

8 

-9.2 

B 

fl 

B 

NISSM  II 
INCOHERENT 

-4.0 

11.4 

-8.4 

5.0 

7.0 

■ 

mm 

B 

■ 

8.7 

RAYMODE  IV 
COHERENT* 

a 

m 

B 

B 

7.1 

0.4 

9.5 

B 

13.1 

10.1 

RAYMODE  IV 
INCOHERENT 

5.8 

8.7 

2.0 

B 

1.8 

n 

3.0 

11.1 

-5.0 

15.1 

1.5 

10.5 

RAYMODE  X 
COHERENT* 

4.8 

2.3 

1.8 

3.2 

1.9 

4.8 

2.0 

2.6 

2.3 

RAYMODE  X 
INCOHERENT 

0.7 

5.6 

-0.5 

B 

2.5 

2.9 

3.9 

6.3 

1.0 

2.1 

1.5 

B 
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Table  C-10 


MEANS  AND  STANDARD  DEVIATIONS  OF 
DIFFERENCES  BETWEEN  THE  FFP*  AND 
PROPAGATION  LOSS  MODELS:  CASES  4-6 


RANGE 
INTERVAL 
(KILO YARDS) 

0-20 

20-40 

40-60 

60-80 

80-100 

0-100 

P 

D 

H 

m 

m 

D 

P 

o 

P 

a 

P 

n 

CONGRATS  V 
COHERENT  * 

0.8 

B 

-0.1 

1.8 

i.i 

3.3 

B 

0.7 

2.0 

0.4 

B 

CONGRATS  V 
INCOHERENT 

B 

2.1 

2.3 

2.8 

3.0 

B 

B 

3.0 

2.1 

3.8 

FACT 

COHERENT* 

0.0 

B 

-2.0 

4.1 

2.0 

5.  1 

0.6 

2.5 

5.1 

0.6 

B 

FACT 

INCOHERENT 

2.1 

2.  1 

2.8 

2.8 

3.8 

■ 

1.0 

■ 

B 

4.0 

NISSM  II 
COHERENT* 

-0.2 

1.4 

-1.3 

2.6 

-0.6 

B 

B 

B 

-1.6 

5.1 

NISSM  II 
INCOHERENT 

1.3 

2.0 

2.1 

2.8 

2.8 

1.0 

3.8 

B 

RAYMODE  IV 
COHERENT* 

1.1 

-4.0 

3.1 

-2.5 

6 . 6 

■ 

B 

B 

B 

RAYMODE  IV 
INCOHERENT 

2.2 

2.1 

-0.8 

3.0 

-0.2 

6.2 

2.8 

n 

5.0 

RAYMODE  X 
COHERENT* 

0.6 

1.9 

0.3 



1.3 

-0.2 

1.8 

m 

B 

l 

B 

B 

RAYMODE  X 
INCOHERENT 

2.0 

2.3 

2.9 

2.9 

B 

0.4 
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Table  C-ll 


MEANS  AND  STANDARD  DEVIATIONS  OF 
DIFFERENCES  BETWEEN  THE  FFP*  AND 
PROPAGATION  LOSS  MODELS:  CASES  1-6 


RANGE 

INTERVAL 

(KILOYARDS) 

0-20 

20-40 

40-60 

60-80 

0-100 

a 

0 

D 

n 

Vi 

D 

■ 

D 

■ 

0 

D 

B 

CONGRATS  V 
COHERENT  * 

0.2 

3.9 

-0.3 

1.4 

0.5 

2.5 

ffl 

B 

B 

-0.3 

4.0 

CONGRATS  V 
INCOHERENT 

2.3 

5.8 

0.6 

a 

B 

1.6 

6.0 

1.4 

3.3 

1.6 

B 

FACT 

COHERENT* 

0.1 

3.0 

-1.8 

3.2 

0.1 

■ 

■ 

-1.2 

6.5 

-0.8 

FACT 

INCOHERENT 

1.1 

■ 

0.2 

1.8 

B 

0.6 

6.0 

NISSM  II 
COHERENT* 

a 

H 

■ 

8.9 

1 

B 

B 

NISSM  II 
INCOHERENT 

-1.4 

8.6 

-3.1 

6.6 

-0.8 

6.9 

a 

8.5 

-3.3 

7.8 

RAYMODE  IV 
COHERENT* 

1.7 

■ 

-4.0 

3.8 

-3.1 

6.9 

0.7 

8.6 

-9.2 

10.7 

-2.8 

8.4 

RAYMODE  IV 
INCOHERENT 

4.0 

0.6 

4.0 

0.8 

6.8 

2.9 

8.6 

B 

11.2 

0.8 

8.3 

RAYMODE  X 
COHERENT* 

1.6 

1.3 

1.9 

1.3 

3.0 

B 

0.1 

3.5 

0.8 

3.6 

RAYMODE  X 
INCOHERENT 

1.4 

a 

1.0 

3.2 

B 

4.0 

2.1 

5.8 

0.6 



B 

1.6 

B 
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MEANS  AND  STANDARD  DEVIATIONS  OF  DIFFERENCES  BETWEEN  PARKA  DATA  AND  MODEL  RESULTS : CASES  7-8 


Table  C-12 
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TABLE  C-13.  SUMS  OF  THE  WEIGHTS*  CORRESPONDING  TO  MEANS  AND 
STANDARD  DEVIATIONS**  OF  DIFFERENCES  BETWEEN 
SMOOTHED  FFP  AND  MODEL  RESULTS 


CASE  3 

1 

o o 
00  o 

Os] 

ro 

ro 

ro 

v£> 

NO 

00 

04 

04 

1 

o o 

NO  00 

04 

to 

ro 

ro 
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m 
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04 

04 
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Tf  vO 

04 

ro 

ro 

to 

NO 

NO 

N O 
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04  r* 
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ro 

ro 

ro 
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NO 

■ 
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04 

04 
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o o 

CM 

04 

04 

to 

ro 

r- 

m 

04 

04 

04 

CASE  2 

m 

sO 

04 

sO 

■ 

LO 

to 

■ 

to 

04 

o o 

NO  00 

■ 

ro 

N D 

nD 

LO 

ro 

B 
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04 
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04 
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04 
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04 
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Os] 

to 

04 

04 

04 

LO 

to 

ro 

04 

04 

m 
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■ 

m 

B 

1 

CASE  1 

1 

o o 
00  o 

f—i 

04 

ro 

04 

ro 

04 

to 

■ 

S O 

04 

04 

1 

o o 

nO  00 

ro 

LO 

to 

LO 

B 

LO 

LO 

B 

to 

B 

1 

o o 

rt  \Q 

Os] 

ro 

04 

to 

04 

04 

LO 

B 

04 

ro 

1 

o o 

Os]  Tt 

04 

04 

04 

ro 

04 

to 

04 

ro 

1 

o o 

0s] 

in 

0- 

ro 

nO 

00 

LO 

LO 

RANGE  INTERVAL 
(KILOYARDS) 

CONGRATS  V 
COHERENT 

CONGRAT  V 
INCOHERENT 

FACT 

COHERENT 

FACT 

INCOHERENT 

NISSM  II 
COHERENT 

NISSM  II 
INCOHERENT 

RAYMODE  IV 
COHERENT 

RAYMODE  IV 
INCOHERENT 

RAYMODE  X 
COHERENT 

RAYMODE  X 
INCOHERENT 
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AS  DEFINED  IN  TABLE  7 **  AS  GIVEN  IN  TABLES  C-l  THROUGH  C-3 


TABLE  C-13.  SUMS  OF  THE  WEIGHTS*  CORRESPONDING  TO  MEANS  AND 
STANDARD  DEVIATIONS**  OF  DIFFERENCES  BETWEEN 
SMOOTHED  FFP  AND  MODEL  RESULTS  (CONT'D) 


CASE  6 

1 

o o 
00  o 

CM 
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to 

eg 

eg 
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o o 
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to 

to 

to 

to 

LO 

m 

LO 

to 

to 

to 
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Csl 

eg 

to 

eg 

to 

eg 

to 

to 

RANGE  INTERVAL 
(KIL0YARDS) 

CONGRATS  V 
COHERENT 

C0NGRAT  V 
INCOHERENT 

FACT 

COHERENT 

FACT 

INCOHERENT 

NISSM  II 
COHERENT 

NISSM  II 
INCOHERENT 

RAYMODE  IV 
COHERENT 

RAYMODE  IV 
INCOHERENT 

RAYMODE  X 
COHERENT 

RAYMODE  X 
INCOHERENT 
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AS  DEFINED  IN  TABLE  7 **  AS  GIVEN  IN  TABLES  C-4  THROUGH  C-6 


TABLE  C- 14 . SUMS  OF  THE  WEIGHTS*  CORRESPONDING  TO 
MEANS  AND  STANDARD  DEVIATIONS**  OF  DIFFERENCES 
BETWEEN  PARKA  DATA  AND  MODEL  RESULTS 
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AS  DEFINED  IN  TABLE  7 


APPENDIX  D 


TABLES  OF  w'S  AND  o'S  OF  DIFFERENCES  BETWEEN  A 
STANDARD  AND  THE  MODELS,  ARRANGED  BY  MODEL 


TABLE  Dl-A 


MEANS  AND  STANDARD  DEVIATIONS  OF  DIFFERENCES 
BETWEEN  THE  STANDARD*  AND  CONGRATS  V (COHERENT) 


RANGE 

INTERVAL 

(KILOYARDS) 

0-20 

20- 

40 

40- 

60 

60- 

80 

80- 

100 

0-100 

CASE 

u 

0 

D 

a 

VI 

a 

0 

u 

a 

a 

0 

1 

3.3 

6.  3 

KB 

0.8 

0.5 

1.3 

1.0 

m 

1.3 

1.2 

1.2 

3.6 

2 

-3.4 

2.5 

-0.7 

0.5 

-1 . 1 

0.  7 

-2.7 

6.7 

jllll 

5.0 

-3.6 

5.2 

3 

-1.0 

1.7 

-0.7 

0.6 

0.1 

0.3 

1.6 

mu 

0.3 

-0.4 

1 . 1 

4 

1.9 

1.5 

0.7 

1.8 

2.9 

4.0 

0.0 

m 

0.8 

1.8 

1.3 

3.7 

S 

0.5 

2.5 

-0.6 

1.9 

0. 1 

3.1 

-0.3 

0.3 

m 

0.0 

3.7 

6 

0.0 

2.5 

m 

1.3 

0.4 

1.6 

-1.8 

1.1 

1.7 

-0.2 

m 

7 

-2.7 

3.8 

m 

4.5 

-0.  1 

2.6 

-3.4 

2.0 

2.7 

-1.9 

EE 

8 

0.6 

2.2 

-1.5 

1.6 

2.6 

2.7 

2.3 

4.1 

1.5 

3.2 

1-3 

-0.4 

4.9 

-0.4 

0.8 

-0.1 

1 . 1 

-0.6 

IB 

B 

-0.9 

IS 

4-6 

B 

2.4 

IB 

1.1 

3.3 

-0.7 

2.0 

0.4 

3.7 

1-6 

D 

3.9 

IB 

m 

EB 

2.5 

IB 

ED 

SO 

4.7 

-0.3 

4.0 

^4 

1 

00 

-1.3 

3.  5 

-3.2 

3.8 

KB 

2.9 

9 

1.7 

2.5 

-0.5 

4.1 

* Smoothed  FFP  for  cases  1-6;  PARKA  data  for  cases  7-8 
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TABLE  1)1 -B 


MEANS  AND  STANDARD  DEVIATIONS  OF  DIFFERENCES 
BETWEEN  THE  STANDARD*  AND  CONGRATS  V (INCOHERENT) 


RANGE 

INTERVAL 

(KILOYARDS) 

0-20 

20-40 

40- 

60 

60- 

80 

80- 

100 

0-100 

CASE 

u 

0 

P 

a 

D 

a 

Ift 

a 

P 

O 

p 

a 

1 

EB 

11.2 

-2.6 

1.6 

m 

1.4 

8.5 

5.8 

1.0 

SI 

mm 

2 

g 

1.3 

K> 

00 

00 

o 

5.5 

0.8 

m 

2.0 

2.5 

m 

3.3 

3 

SB 

B 

0.2 

m 

0.1 

-3.0 

1.8 

-3.6 

0.3 

B 

1.0 

4 

4.3 

2.3 

4.0 

4.2 

5.6 

7.3 

0.4 

5.1 

0.7 

2.8 

3.0 

5.  1 

5 

1.4 

1.2 

1.2 

0.6 

1.0 

1.0 

0.9 

g 

6 

1.6 

1.2 

1.6 

1.2 

2.4 

1.6 

0.3 

4.2 

Q 

1.8 

7 

0.7 

2.7 

-1.3 

1.4 

2.5 

EB 

-2.0 

4.5 

2.2 

2.8 

0.3 

8 

1.8 

1.4 

-0.8 

4.0 

g 

2.7 

IB 

3.8 

g 

1-3 

2.1 

7.9 

-i.i 

m 

1.8 

_ J 

2.6 

3.5 

4-6 

m 

2.1 

2.3 

r° 

00 

IB 

0.5 

2.1 

1-6 

5.8 

0.6 

i 

m 

EB 

1.6 

6.0 

1.4 

B 

7-8 

1.2 

2. 2 

-1.1 

m 

2.9 

0.9 

3 

B 

1.3 

3.5 

* Smoothed  PFP  for  cases  1-6;  PARKA  data  for  cases  7-8 
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TABLE  D2- A 


MEANS  AND  STANDARD  DEVIATIONS  OF  DIFFERENCES 
BETWEEN  THE  STANDARD*  AND  FACT  (COHERENT) 


RANCE 

INTERVAL 

(KILOYARDS) 

0-20 

20-40 

40-60 

60-80 

80-100 

0-100 

CASE 

D 

0 

D 

0 

rri 

a 

y 

0 

D 

a 

u 

a 

1 

2.9 

i.i 

-0.4 

5.0 

1.6 

2.3 

0.7 

3.2 

2 

1.0 

1.9 

-o.s 

0.9 

SB 

10.  1 

-11.0 

Qj 

±11 

m 

3 

-4.1 

1.9 

-5.2 

0.3 

SB 

i . i 

4 

0.  1 

4.0 

5.0 

3.6 

2.6 

4.1 

5 

0.3 

6 

0.4 

2.3 

0.7 

0.2 

Illy 

2.1 

3.6 

/ 

-2.8 

-4.8 

3.6 

l2  2i 



4.0 

-1.8 

5.1 

6.8 

QQj 

8 

-0.3 

-2.4 

1.6 

1.5 

3.8 

3.9 

0.6 

gg 

3.7 

1-3 

0.2 

3.6 

1.7 

2.1 

-3.1 

6.8 

-4.8 

my 

SB 

4.7 

4-6 

0.0 

2.4 

B3 

4.1 

2.0 

5.  1 

0.6 

4.2 

2.5 

SB 

m 

1-6 

0. 1 

3.2 

0.1 

4.3 

-1.3 

5.9 

-1.2 

g 

SB 

SB 

7-8 

-1.8 

2.3 

1.7 

3.3 

1.5 

5.2 

4.9 

0.1 

4.7 

* Smoothed  FFP  for  cases  1-6;  PARKA  data  for  cases  7-8 
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TABLE  D2-B 


MEANS  AND  STANDARD  DEVIATIONS  OE  DIFFERENCES 
BETWEEN  THE  STANDARD*  AND  FACT  (INCOHERENT) 


RANGE 

INTERVAL 

(KILOYARDS) 

0-20 

20-40 

40-60 

60-80 

80-100 

0-100 

CASE 

m 

0 

D 

0 

OK 

0 

m 

0 

o 

0 

n 

a 

1 

2.8 

8.4 

-3. 1 

2.0 

3.6 

1.2 

5.7 

8.7 

KB 

m 

2.7 

6.3 

2 

-0.4 

0.6 

0.3 

- 

9.0 

-7.6 

2.3 

H9 

5.5 

3 

D 

0.2 

-4.3 

0.2 

B 

1.7 

-5.2 

KB 

1.0 

4 

2.2 

in 

m 

6.2 

6.2 

4.8 

1.4 

4.8 

S 

i.i 

1.5 

1.8 

0.6 

1.9 

1.7 

..8 

_ 

6.0 

5.0 

4.8 

2.3 

6 

1.6 

3.2 

2.6 

3.9 

5.5 

3.5 

m 

3.2 

7 

-1.1 

IS 

3.2 

2.2 

sa 

m 

KB 

9 

0.6 

Bl 

8 

2.0 

1.5 

-0.2 

D 

4.9 

1.3 

BB 

BK 

1-3 

0. 1 

m 

-0.1 

QQj 

-1.5 

m 

KB 

5.7 

warn 

2.1 

2.1 

2.8 

2.8 

3.8 

KB 

1.0 

H||f 

BgS| 

BB 

1-6 

1.1 

4.3 

1.8 

B 

-0.3 

5.3 

7-8 

1.1 

-0.8 

1.5 

3.8 

2.1 

1.5 

m 

3.7 

2.0 

3.8 

* Smoothed  FFP  for  cases  1-6;  PARKA  data  for  cases  7-8 
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i 


TABLE  D3-A 


MEANS  AND  STANDARD  DEVIATIONS  OF  DIFFERENCES 
BETWEEN  THE  STANDARD*  AND  FFP  (CW) 


RANGE 

INTERVAL 
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